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PREFACE 


This 10th edition of Biostatistics: A Foundation for Analysis in the Health Sciences was 
prepared with the objective of appealing to a wide audience. Previous editions of the book 
have been used by the authors and their colleagues in a variety of contexts. For under- 
graduates, this edition should provide an introduction to statistical concepts for students in 
the biosciences, health sciences, and for mathematics majors desiring exposure to applied 
statistical concepts. Like its predecessors, this edition is designed to meet the needs of 
beginning graduate students in various fields such as nursing, applied sciences, and public 
health who are seeking a strong foundation in quantitative methods. For professionals 
already working in the health field, this edition can serve as a useful desk reference. 

The breadth of coverage provided in this text, along with the hundreds of practical 
exercises, allow instructors extensive flexibility in designing courses at many levels. To 
that end, we offer below some ideas on topical coverage that we have found to be useful in 
the classroom setting. 

Like the previous editions of this book, this edition requires few mathematical pre- 
requisites beyond a solid proficiency in college algebra. We have maintained an emphasis 
on practical and intuitive understanding of principles rather than on abstract concepts that 
underlie some methods, and that require greater mathematical sophistication. With that in 
mind, we have maintained a reliance on problem sets and examples taken directly from the 
health sciences literature instead of contrived examples. We believe that this makes the text 
more interesting for students, and more practical for practicing health professionals who 
reference the text while performing their work duties. 

For most of the examples and statistical techniques covered in this edition, we 
discuss the use of computer software for calculations. Experience has informed our 
decision to include example printouts from a variety of statistical software in this edition 
(e.g., MINITAB, SAS, SPSS, and R). We feel that the inclusion of examples from these 
particular packages, which are generally the most commonly utilized by practitioners, 
provides a rich presentation of the material and allows the student the opportunity to 
appreciate the various technologies used by practicing statisticians. 


CHANGES AND UPDATES TO THIS EDITION 


The majority of the chapters include corrections and clarifications that enhance the material 
that is presented and make it more readable and accessible to the audience. We did, 
however, make several specific changes and improvements that we believe are valuable 
contributions to this edition, and we thank the reviewers of the previous edition for their 
comments and suggestions in that regard. 
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Specific changes to this edition include additional text concerning measures of 
dispersion in Chapter 2, additional text and examples using program R in Chapter 6, a new 
introduction to linear models in Chapter 8 that ties together the regression and ANOVA 
concepts in Chapters 8-11, the addition of two-factor repeated measures ANOVA in 
Chapter 8, a discussion of the similarities of ANOVA and regression in Chapter 11, 
and extensive new text and examples on testing the fit of logistic regression models in 
Chapter 11. 

Most important to this new edition is a new Chapter 14 on Survival Analysis. This 
new chapter was borne out of requests from reviewers of the text and from the experience 
of the authors in terms of the growing use of these methods in applied research. In this 
new chapter, we included some of the material found in Chapter 12 in previous editions, 
and added extensive material and examples. We provide introductory coverage of 
censoring, Kaplan-Meier estimates, methods for comparing survival curves, and the 
Cox Regression Proportional Hazards model. Owing to this new material, we elected 
to move the contents of the vital statistics chapter to a new Chapter 15 and make it 
available online (www.wiley.com/college/daniel). 


COURSE COVERAGE IDEAS 


In the table below we provide some suggestions for topical coverage in a variety of 
contexts, with “X” indicating those chapters we believe are most relevant for a variety of 
courses for which this text is appropriate. The text has been designed to be flexible in order 
to accommodate various teaching styles and various course presentations. Although the 
text is designed with progressive presentation of concepts in mind, certain of the topics may 
be skipped or covered briefly so that focus can be placed on concepts important to 
instructors. 


Course 


Chapters 


1123456789110 | п | 12 | 13 | 14 | 15 


Undergraduate course for health | X | X | X | X|X|X|X|X|X|O OX О О О 
sciences students 


Undergraduate course in хоо оххх ххх охх X О 
applied statistics for 
mathematics majors 


First biostatistics course for X|X X X|X|X X X X|X O X X X О 
beginning graduate students 


Biostatistics course for graduate 
health sciences students who 
have completed an introductory 
statistics course 


X: Suggested coverage; O: Optional coverage. 
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SUPPLEMENTS 


Instructor's Solutions Manual. Prepared by Dr. Chad Cross, this manual includes 
solutions to all problems found in the text. This manual is available only to instructors 
who have adopted the text. 


Student Solutions Manual. Prepared by Dr. Chad Cross, this manual includes solutions 
to all odd-numbered exercises. This manual may be packaged with the text at a discounted 
price. 


Data Sets. More than 250 data sets are available online to accompany the text. These data 
sets include those data presented in examples, exercises, review exercises, and the large 
data sets found in some chapters. These are available in SAS, SPSS, and Minitab formats 
as well as CSV format for importing into other programs. Data are available for down- 
loading at 


www.wiley.com/college/daniel 


Those without Internet access may contact Wiley directly at 111 River Street, Hoboken, NJ 
07030-5774; telephone: 1-877-762-2974. 
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CHAPTER 1 


INTRODUCTION TO 
BIOSTATISTICS 


CHAPTER OVERVIEW 


This chapter is intended to provide an overview of the basic statistical 
concepts used throughout the textbook. A course in statistics requires the 
student to learn many new terms and concepts. This chapter lays the founda- 
tion necessary for understanding basic statistical terms and concepts and the 
role that statisticians play in promoting scientific discovery and wisdom. 


TOPICS 
1.1 INTRODUCTION 
1.2 SOME BASIC CONCEPTS 
1.3 MEASUREMENT AND MEASUREMENT SCALES 
1.4 SAMPLING AND STATISTICAL INFERENCE 
1.5 THE SCIENTIFIC METHOD AND THE DESIGN OF EXPERIMENTS 
1.6 COMPUTERS AND BIOSTATISTICAL ANALYSIS 
17 SUMMARY 


LEARNING OUTCOMES 


After studying this chapter, the student will 

1. understand the basic concepts and terminology of biostatistics, including the 
various kinds of variables, measurement, and measurement scales. 

2. be able to select a simple random sample and other scientific samples from a 
population of subjects. 

3. understand the processes involved in the scientific method and the design of 
experiments. 

4. appreciate the advantages of using computers in the statistical analysis of data 
generated by studies and experiments conducted by researchers in the health 
sciences. 
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CHAPTER 1 


INTRODUCTION TO BIOSTATISTICS 


INTRODUCTION 


We are frequently reminded of the fact that we are living in the information age. 
Appropriately, then, this book is about information—how it is obtained, how it is analyzed, 
and how it is interpreted. The information about which we are concerned we call data, and 
the data are available to us in the form of numbers. 

The objectives of this book are twofold: (1) to teach the student to organize and 
summarize data, and (2) to teach the student how to reach decisions about a large body of 
data by examining only a small part of it. The concepts and methods necessary for 
achieving the first objective are presented under the heading of descriptive statistics, and 
the second objective is reached through the study of what is called inferential statistics. 
This chapter discusses descriptive statistics. Chapters 2 through 5 discuss topics that form 
the foundation of statistical inference, and most of the remainder of the book deals with 
inferential statistics. 

Because this volume is designed for persons preparing for or already pursuing a 
career in the health field, the illustrative material and exercises reflect the problems and 
activities that these persons are likely to encounter in the performance of their duties. 


1.2 SOME BASIC CONCEPTS 


Like all fields of learning, statistics has its own vocabulary. Some of the words and phrases 
encountered in the study of statistics will be new to those not previously exposed to the 
subject. Other terms, though appearing to be familiar, may have specialized meanings that 
are different from the meanings that we are accustomed to associating with these terms. 
The following are some terms that we will use extensively in this book. 


Data The raw material of statistics is data. For our purposes we may define data as 
numbers. The two kinds of numbers that we use in statistics are numbers that result from 
the taking—in the usual sense of the term—of a measurement, and those that result 
from the process of counting. For example, when a nurse weighs a patient or takes 
a patient's temperature, a measurement, consisting of a number such as 150 pounds or 
100 degrees Fahrenheit, is obtained. Quite a different type of number is obtained when a 
hospital administrator counts the number of patients—perhaps 20—discharged from the 
hospital on a given day. Each of the three numbers is a datum, and the three taken 
together are data. 


Statistics The meaning of statistics is implicit in the previous section. More 
concretely, however, we may say that statistics is a field of study concerned with (1) 
the collection, organization, summarization, and analysis of data; and (2) the drawing of 
inferences about a body of data when only a part of the data is observed. 

The person who performs these statistical activities must be prepared to interpret and 
to communicate the results to someone else as the situation demands. Simply put, we may 
say that data are numbers, numbers contain information, and the purpose of statistics is to 
investigate and evaluate the nature and meaning of this information. 
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Sources of Data The performance of statistical activities is motivated by the 
need to answer a question. For example, clinicians may want answers to questions 
regarding the relative merits of competing treatment procedures. Administrators may 
want answers to questions regarding such areas of concern as employee morale or 
facility utilization. When we determine that the appropriate approach to seeking an 
answer to a question will require the use of statistics, we begin to search for suitable data 
to serve as the raw material for our investigation. Such data are usually available from 
one or more of the following sources: 


1. Routinely kept records. It is difficult to imagine any type of organization that 
does not keep records of day-to-day transactions of its activities. Hospital medical 
records, for example, contain immense amounts of information on patients, while 
hospital accounting records contain a wealth of data on the facility's business 
activities. When the need for data arises, we should look for them first among 
routinely kept records. 


2. Surveys. If the data needed to answer a question are not available from routinely 
kept records, the logical source may be a survey. Suppose, for example, that the 
administrator of a clinic wishes to obtain information regarding the mode of 
transportation used by patients to visit the clinic. If admission forms do not contain 
a question on mode of transportation, we may conduct a survey among patients to 
obtain this information. 


3. Experiments. Frequently the data needed to answer a question are available only as 
the result of an experiment. A nurse may wish to know which of several strategies is 
best for maximizing patient compliance. The nurse might conduct an experiment in 
which the different strategies of motivating compliance are tried with different 
patients. Subsequent evaluation of the responses to the different strategies might 
enable the nurse to decide which is most effective. 


4. External sources. The data needed to answer a question may already exist in the 
form of published reports, commercially available data banks, or the research 
literature. In other words, we may find that someone else has already asked the 
same question, and the answer obtained may be applicable to our present 
situation. 


Biostatistics The tools of statistics are employed in many fields—business, 
education, psychology, agriculture, and economics, to mention only a few. When the 
data analyzed are derived from the biological sciences and medicine, we use the term 
biostatistics to distinguish this particular application of statistical tools and concepts. This 
area of application is the concern of this book. 


Variable If, as we observe a characteristic, we find that it takes on different values 
in different persons, places, or things, we label the characteristic a variable. We do this 
for the simple reason that the characteristic is not the same when observed in different 
possessors of it. Some examples of variables include diastolic blood pressure, heart rate, 
the heights of adult males, the weights of preschool children, and the ages of patients 
seen in a dental clinic. 
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Quantitative Variables A quantitative variable is one that can be measured in 
the usual sense. We can, for example, obtain measurements on the heights of adult males, 
the weights of preschool children, and the ages of patients seen in a dental clinic. These are 
examples of quantitative variables. Measurements made on quantitative variables convey 
information regarding amount. 


Qualitative Variables Some characteristics are not capable of being measured 
in the sense that height, weight, and age are measured. Many characteristics can be 
categorized only, as, for example, when an ill person is given a medical diagnosis, a 
person is designated as belonging to an ethnic group, or a person, place, or object is 
said to possess or not to possess some characteristic of interest. In such cases 
measuring consists of categorizing. We refer to variables of this kind as qualitative 
variables. Measurements made on qualitative variables convey information regarding 
attribute. 

Although, in the case of qualitative variables, measurement in the usual sense of the 
word is not achieved, we can count the number of persons, places, or things belonging to 
various categories. A hospital administrator, for example, can count the number of patients 
admitted during a day under each of the various admitting diagnoses. These counts, or 
frequencies as they are called, are the numbers that we manipulate when our analysis 
involves qualitative variables. 


Random Variable Whenever we determine the height, weight, or age of an 
individual, the result is frequently referred to as a value of the respective variable. 
When the values obtained arise as a result of chance factors, so that they cannot be 
exactly predicted in advance, the variable is called a random variable. An example of a 
random variable is adult height. When a child is born, we cannot predict exactly his or her 
height at maturity. Attained adult height is the result of numerous genetic and environ- 
mental factors. Values resulting from measurement procedures are often referred to as 
observations or measurements. 


Discrete Random Variable Variables may be characterized further as to 
whether they are discrete or continuous. Since mathematically rigorous definitions of 
discrete and continuous variables are beyond the level of this book, we offer, instead, 
nonrigorous definitions and give an example of each. 

A discrete variable is characterized by gaps or interruptions in the values that it can 
assume. These gaps or interruptions indicate the absence of values between particular 
values that the variable can assume. Some examples illustrate the point. The number of 
daily admissions to a general hospital is a discrete random variable since the number of 
admissions each day must be represented by a whole number, such as 0, 1, 2, or 3. The 
number of admissions on a given day cannot be a number such as 1.5, 2.997, or 3.333. The 
number of decayed, missing, or filled teeth per child in an elementary school is another 
example of a discrete variable. 


Continuous Random Variable A continuous random variable does not 
possess the gaps or interruptions characteristic of a discrete random variable. A 
continuous random variable can assume any value within a specified relevant interval 
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of values assumed by the variable. Examples of continuous variables include the various 
measurements that can be made on individuals such as height, weight, and skull 
circumference. No matter how close together the observed heights of two people, for 
example, we can, theoretically, find another person whose height falls somewhere in 
between. 

Because of the limitations of available measuring instruments, however, observa- 
tions on variables that are inherently continuous are recorded as if they were discrete. 
Height, for example, is usually recorded to the nearest one-quarter, one-half, or whole 
inch, whereas, with a perfect measuring device, such a measurement could be made as 
precise as desired. 


Population The average person thinks of a population as a collection of entities, 
usually people. A population or collection of entities may, however, consist of animals, 
machines, places, or cells. For our purposes, we define a population of entities as the 
largest collection of entities for which we have an interest at a particular time. If we take a 
measurement of some variable on each of the entities in a population, we generate a 
population of values of that variable. We may, therefore, define a population of values as 
the largest collection of values of a random variable for which we have an interest at a 
particular time. If, for example, we are interested in the weights of all the children enrolled 
in a certain county elementary school system, our population consists of all these weights. 
If our interest lies only in the weights of first-grade students in the system, we have a 
different population— weights of first-grade students enrolled in the school system. Hence, 
populations are determined or defined by our sphere of interest. Populations may be finite 
or infinite. If a population of values consists of a fixed number of these values, the 
population is said to be finite. If, on the other hand, a population consists of an endless 
succession of values, the population is an infinite one. 


Sample A sample may be defined simply as a part of a population. Suppose our 
population consists of the weights of all the elementary school children enrolled in a certain 
county school system. If we collect for analysis the weights of only a fraction of these 
children, we have only a part of our population of weights, that is, we have a sample. 


1.3 MEASUREMENT AND 
MEASUREMENT SCALES 


In the preceding discussion we used the word measurement several times in its usual sense, 
and presumably the reader clearly understood the intended meaning. The word measure- 
ment, however, may be given a more scientific definition. In fact, there is a whole body of 
scientific literature devoted to the subject of measurement. Part of this literature is 
concerned also with the nature of the numbers that result from measurements. Authorities 
on the subject of measurement speak of measurement scales that result in the categoriza- 
tion of measurements according to their nature. In this section we define measurement and 
the four resulting measurement scales. A more detailed discussion of the subject is to be 
found in the writings of Stevens (1,2). 
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Measurement This may be defined as the assignment of numbers to objects or 
events according to a set of rules. The various measurement scales result from the fact that 
measurement may be carried out under different sets of rules. 


The Nominal Scale The lowest measurement scale is the nominal scale. As the 
name implies it consists of "naming" observations or classifying them into various 
mutually exclusive and collectively exhaustive categories. The practice of using numbers 
to distinguish among the various medical diagnoses constitutes measurement on a nominal 
scale. Other examples include such dichotomies as male-female, well—sick, under 65 years 
of age-65 and over, child-adult, and married-not married. 


The Ordinal Scale Whenever observations are not only different from category to 
category but can be ranked according to some criterion, they are said to be measured on an 
ordinal scale. Convalescing patients may be characterized as unimproved, improved, and 
much improved. Individuals may be classified according to socioeconomic status as low, 
medium, or high. The intelligence of children may be above average, average, or below 
average. In each of these examples the members of any one category are all considered 
equal, but the members of one category are considered lower, worse, or smaller than those 
in another category, which in turn bears a similar relationship to another category. For 
example, a much improved patient is in better health than one classified as improved, while 
a patient who has improved is in better condition than one who has not improved. It is 
usually impossible to infer that the difference between members of one category and the 
next adjacent category is equal to the difference between members of that category and the 
members of the next category adjacent to it. The degree of improvement between 
unimproved and improved is probably not the same as that between improved and 
much improved. The implication is that if a finer breakdown were made resulting in 
more categories, these, too, could be ordered in a similar manner. The function of numbers 
assigned to ordinal data is to order (or rank) the observations from lowest to highest and, 
hence, the term ordinal. 


The Interval Scale The interval scale is a more sophisticated scale than the nominal 
or ordinal in that with this scale not only is it possible to order measurements, but also the 
distance between any two measurements is known. We know, say, that the difference between 
a measurement of 20 and a measurement of 30 is equal to the difference between 
measurements of 30 and 40. The ability to do this implies the use of a unit distance and 
a zero point, both of which are arbitrary. The selected zero point is not necessarily a true zero 
in that it does not have to indicate a total absence of the quantity being measured. Perhaps the 
best example of an interval scale is provided by the way in which temperature is usually 
measured (degrees Fahrenheit or Celsius). The unit of measurement is the degree, and the 
point of comparison is the arbitrarily chosen “zero degrees,” which does not indicate a lack of 
heat. The interval scale unlike the nominal and ordinal scales is a truly quantitative scale. 


The Ratio Scale The highest level of measurement is the ratio scale. This scale is 
characterized by the fact that equality of ratios as well as equality of intervals may be 
determined. Fundamental to the ratio scale is a true zero point. The measurement of such 
familiar traits as height, weight, and length makes use of the ratio scale. 
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1.4 SAMPLING AND 
STATISTICAL INFERENCE 


As noted earlier, one of the purposes of this book is to teach the concepts of statistical 
inference, which we may define as follows: 


DEFINITION 


Statistical inference is the procedure by which we reach a conclusion 
about a population on the basis of the information contained in a sample 
that has been drawn from that population. 


There are many kinds of samples that may be drawn from a population. Not every 
kind of sample, however, can be used as a basis for making valid inferences about a 
population. In general, in order to make a valid inference about a population, we need a 
scientific sample from the population. There are also many kinds of scientific samples that 
may be drawn from a population. The simplest of these is the simple random sample. In this 
section we define a simple random sample and show you how to draw one from a 
population. 

If we use the letter N to designate the size of a finite population and the letter n to 
designate the size of a sample, we may define a simple random sample as follows: 


DEFINITION 


If a sample of size n is drawn from a population of size N in such a way 
that every possible sample of size n has the same chance of being selected, 
the sample is called a simple random sample. 


The mechanics of drawing a sample to satisfy the definition of a simple random 
sample is called simple random sampling. 

We will demonstrate the procedure of simple random sampling shortly, but first let us 
consider the problem of whether to sample with replacement or without replacement. When 
sampling with replacement is employed, every member of the population is available at 
each draw. For example, suppose that we are drawing a sample from a population of former 
hospital patients as part of a study of length of stay. Let us assume that the sampling 
involves selecting from the shelves in the medical records department a sample of charts of 
discharged patients. In sampling with replacement we would proceed as follows: select a 
chart to be in the sample, record the length of stay, and return the chart to the shelf. The 
chart is back in the "population" and may be drawn again on some subsequent draw, in 
which case the length of stay will again be recorded. In sampling without replacement, we 
would not return a drawn chart to the shelf after recording the length of stay, but would lay 
it aside until the entire sample is drawn. Following this procedure, a given chart could 
appear in the sample only once. As a rule, in practice, sampling is always done without 
replacement. The significance and consequences of this will be explained later, but first let 
us see how one goes about selecting a simple random sample. To ensure true randomness of 
selection, we will need to follow some objective procedure. We certainly will want to avoid 
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using our own judgment to decide which members of the population constitute a random 
sample. The following example illustrates one method of selecting a simple random sample 
from a population. 


EXAMPLE 1.4.1 


Gold et al. (A-1) studied the effectiveness on smoking cessation of bupropion SR, a 
nicotine patch, or both, when co-administered with cognitive-behavioral therapy. Consec- 
utive consenting patients assigned themselves to one of the three treatments. For illustrative 
purposes, let us consider all these subjects to be a population of size N — 189. We wish to 
select a simple random sample of size 10 from this population whose ages are shown in 
Table 1.4.1. 


TABLE 1.4.1 Ages of 189 Subjects Who Participated in a Study on Smoking 
Cessation 


Subject No. Age Subject No. Age Subject No. Age Subject No. Age 


1 48 49 38 97 51 145 52 
2 35 50 44 98 50 146 53 
3 46 51 43 99 50 147 61 
4 44 52 47 100 55 148 60 
5 43 53 46 101 63 149 53 
6 42 54 57 102 50 150 53 
7 39 55 52 103 59 151 50 
8 44 56 54 104 54 152 53 
9 49 57 56 105 60 153 54 
10 49 58 53 106 50 154 61 
11 44 59 64 107 56 155 61 
12 39 60 53 108 68 156 61 
13 38 61 58 109 66 157 64 
14 49 62 54 110 71 158 53 
15 49 63 59 111 82 159 53 
16 53 64 56 112 68 160 54 
17 56 65 62 113 78 161 61 
18 57 66 50 114 66 162 60 
19 51 67 64 115 70 163 51 
20 61 68 53 116 66 164 50 
21 53 69 61 117 78 165 53 
22 66 70 53 118 69 166 64 
23 71 71 62 119 71 167 64 
24 75 72 57 120 69 168 53 
25 72 73 52 121 78 169 60 
26 65 74 54 122 66 170 54 
27 67 75 61 123 68 171 55 
28 38 76 59 124 71 172 58 


(Continued) 
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Subject No. Age Subject No. Age Subject No. Age Subject No. Age 
29 37 77 57 125 69 173 62 
30 46 78 52 126 77 174 62 
31 44 79 54 127 76 175 54 
32 44 80 53 128 71 176 53 
33 48 81 62 129 43 177 61 
34 49 82 52 130 47 178 54 
35 30 83 62 131 48 179 51 
36 45 84 57 132 37 180 62 
37 47 85 59 133 40 181 57 
38 45 86 59 134 42 182 50 
39 48 87 56 135 38 183 64 
40 47 88 57 136 49 184 63 
41 47 89 53 137 43 185 65 
42 44 90 59 138 46 186 71 
43 48 91 61 139 34 187 71 
44 43 92 55 140 46 188 73 
45 45 93 61 141 46 189 66 
46 40 94 56 142 48 

47 48 95 52 143 47 

48 49 96 54 144 43 


Source: Data provided courtesy of Paul B. Gold, Ph.D. 


Solution: 


One way of selecting a simple random sample is to use a table of random 
numbers like that shown in the Appendix, Table A. As the first step, we locate 
a random starting point in the table. This can be done in a number of ways, 
one of which is to look away from the page while touching it with the point of 
a pencil. The random starting point is the digit closest to where the pencil 
touched the page. Let us assume that following this procedure led to a random 
starting point in Table A at the intersection of row 21 and column 28. The 
digit at this point is 5. Since we have 189 values to choose from, we can use 
only the random numbers 1 through 189. It will be convenient to pick three- 
digit numbers so that the numbers 001 through 189 will be the only eligible 
numbers. The first three-digit number, beginning at our random starting point 
is 532, a number we cannot use. The next number (going down) is 196, which 
again we cannot use. Let us move down past 196, 372, 654, and 928 until we 
come to 137, a number we can use. The age of the 137th subject from Table 
1.4.1 is 43, the first value in our sample. We record the random number and 
the corresponding age in Table 1.4.2. We record the random number to keep 
track of the random numbers selected. Since we want to sample without 
replacement, we do not want to include the same individual's age twice. 
Proceeding in the manner just described leads us to the remaining nine 
random numbers and their corresponding ages shown in Table 1.4.2. Notice 
that when we get to the end of the column, we simply move over three digits 
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TABLE 1.4.2 Sample of 
10 Ages Drawn from the 
Ages in Table 1.4.1 


Random Sample 

Number Subject Number Age 
137 1 43 
114 2 66 
155 3 61 
183 4 64 
185 5 65 
028 6 38 
085 7 59 
181 8 57 
018 9 57 
164 10 50 


to 028 and proceed up the column. We could have started at the top with the 
number 369. 

Thus we have drawn a simple random sample of size 10 from a 
population of size 189. In future discussions, whenever the term simple 
random sample is used, it will be understood that the sample has been drawn 
in this or an equivalent manner. A 


The preceding discussion of random sampling is presented because of the important 
role that the sampling process plays in designing research studies and experiments. The 
methodology and concepts employed in sampling processes will be described in more 
detail in Section 1.5. 


DEFINITION 


A research study is a scientific study of a phenomenon of interest. 
Research studies involve designing sampling protocols, collecting and 
analyzing data, and providing valid conclusions based on the results of 
the analyses. 


DEFINITION 


Experiments are a special type of research study in which observations 
are made after specific manipulations of conditions have been carried 
out; they provide the foundation for scientific research. 


Despite the tremendous importance of random sampling in the design of research 
studies and experiments, there are some occasions when random sampling may not be the 
most appropriate method to use. Consequently, other sampling methods must be consid- 
ered. The intention here is not to provide a comprehensive review of sampling methods, but 
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rather to acquaint the student with two additional sampling methods that are employed in 
the health sciences, systematic sampling and stratified random sampling. Interested readers 
are referred to the books by Thompson (3) and Levy and Lemeshow (4) for detailed 
overviews of various sampling methods and explanations of how sample statistics are 
calculated when these methods are applied in research studies and experiments. 


Systematic Sampling A sampling method that is widely used in healthcare 
research is the systematic sample. Medical records, which contain raw data used in 
healthcare research, are generally stored in a file system or on a computer and hence are 
easy to select in a systematic way. Using systematic sampling methodology, a researcher 
calculates the total number of records needed for the study or experiment at hand. A 
random numbers table is then employed to select a starting point in the file system. The 
record located at this starting point is called record x. A second number, determined by the 
number of records desired, is selected to define the sampling interval (call this interval k). 
Consequently, the data set would consist of records x, x + k, x + 2k, x + 3k, and so on, until 
the necessary number of records are obtained. 


EXAMPLE 1.4.2 


Continuing with the study of Gold et al. (A-1) illustrated in the previous example, imagine 
that we wanted a systematic sample of 10 subjects from those listed in Table 1.4.1. 


Solution: To obtain a starting point, we will again use Appendix Table A. For purposes 
of illustration, let us assume that the random starting point in Table A was the 
intersection of row 10 and column 30. The digit is a 4 and will serve as our 
starting point, x. Since we are starting at subject 4, this leaves 185 remaining 
subjects (i.e., 189—4) from which to choose. Since we wish to select 10 
subjects, one method to define the sample interval, k, would be to take 
185/10 — 18.5. To ensure that there will be enough subjects, it is customary to 
round this quotient down, and hence we will round the result to 18. The 
resulting sample is shown in Table 1.4.3. 


TABLE 1.4.3 Sample of 10 Ages Selected Using a 
Systematic Sample from the Ages in Table 1.4.1 


Systematically Selected Subject Number Age 

4 44 
22 66 
40 47 
58 53 
76 59 
94 56 
112 68 
130 47 
148 60 
166 64 
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Stratified Random Sampling A common situation that may be encountered 
in a population under study is one in which the sample units occur together in a grouped 
fashion. On occasion, when the sample units are not inherently grouped, it may be possible 
and desirable to group them for sampling purposes. In other words, it may be desirable to 
partition a population of interest into groups, or strata, in which the sample units within a 
particular stratum are more similar to each other than they are to the sample units that 
compose the other strata. After the population is stratified, it is customary to take a random 
sample independently from each stratum. This technique is called stratified random 
sampling. The resulting sample is called a stratified random sample. Although the benefits 
of stratified random sampling may not be readily observable, it is most often the case that 
random samples taken within a stratum will have much less variability than a random 
sample taken across all strata. This is true because sample units within each stratum tend to 
have characteristics that are similar. 


EXAMPLE 1.4.3 


Hospital trauma centers are given ratings depending on their capabilities to treat various 
traumas. In this system, a level 1 trauma center is the highest level of available trauma care 
and a level 4 trauma center is the lowest level of available trauma care. Imagine that we are 
interested in estimating the survival rate of trauma victims treated at hospitals within a 
large metropolitan area. Suppose that the metropolitan area has a level 1, a level 2, and a 
level 3 trauma center. We wish to take samples of patients from these trauma centers in such 
a way that the total sample size is 30. 


Solution: We assume that the survival rates of patients may depend quite significantly 
on the trauma that they experienced and therefore on the level of care that 
they receive. As a result, a simple random sample of all trauma patients, 
without regard to the center at which they were treated, may not represent 
true survival rates, since patients receive different care at the various trauma 
centers. One way to better estimate the survival rate is to treat each trauma 
center as a stratum and then randomly select 10 patient files from each of the 
three centers. This procedure is based on the fact that we suspect that the 
survival rates within the trauma centers are less variable than the survival 
rates across trauma centers. Therefore, we believe that the stratified random 
sample provides a better representation of survival than would a sample taken 
without regard to differences within strata. al 


It should be noted that two slight modifications of the stratified sampling technique 
are frequently employed. To illustrate, consider again the trauma center example. In the 
first place, a systematic sample of patient files could have been selected from each trauma 
center (stratum). Such a sample is called a stratified systematic sample. 

The second modification of stratified sampling involves selecting the sample from a 
given stratum in such a way that the number of sample units selected from that stratum is 
proportional to the size of the population of that stratum. Suppose, in our trauma center 
example that the level 1 trauma center treated 100 patients and the level 2 and level 3 
trauma centers treated only 10 each. In that case, selecting a random sample of 10 from 
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each trauma center overrepresents the trauma centers with smaller patient loads. To avoid 
this problem, we adjust the size of the sample taken from a stratum so that it is proportional 
to the size of the stratum's population. This type of sampling is called stratified sampling 
proportional to size. The within-stratum samples can be either random or systematic as 
described above. 


EXERCISES 


1.4.1 Using the table of random numbers, select a new random starting point, and draw another simple 
random sample of size 10 from the data in Table 1.4.1. Record the ages of the subjects in this new 
sample. Save your data for future use. What is the variable of interest in this exercise? What 
measurement scale was used to obtain the measurements? 


1.4.3 Select another simple random sample of size 10 from the population represented in Table 1.4.1. 
Compare the subjects in this sample with those in the sample drawn in Exercise 1.4.1. Are there any 
subjects who showed up in both samples? How many? Compare the ages of the subjects in the two 
samples. How many ages in the first sample were duplicated in the second sample? 


1.4.3 Using the table of random numbers, select a random sample and a systematic sample, each of size 15, 
from the data in Table 1.4.1. Visually compare the distributions of the two samples. Do they appear 
similar? Which appears to be the best representation of the data? 


1.4.4 Construct an example where it would be appropriate to use stratified sampling. Discuss how you 
would use stratified random sampling and stratified sampling proportional to size with this example. 
Which do you think would best represent the population that you described in your example? Why? 


1.5 THESCIENTIFIC METHOD 
AND THE DESIGN OF EXPERIMENTS 


Data analyses using a broad range of statistical methods play a significant role in scientific 
studies. The previous section highlighted the importance of obtaining samples in a 
scientific manner. Appropriate sampling techniques enhance the likelihood that the results 
of statistical analyses of a data set will provide valid and scientifically defensible results. 
Because of the importance of the proper collection of data to support scientific discovery, it 
is necessary to consider the foundation of such discovery—the scientific method—and to 
explore the role of statistics in the context of this method. 


DEFINITION 


The scientific method is a process by which scientific information is 
collected, analyzed, and reported in order to produce unbiased and 
replicable results in an effort to provide an accurate representation of 
observable phenomena. 


The scientific method is recognized universally as the only truly acceptable way to 
produce new scientific understanding of the world around us. It is based on an empirical 
approach, in that decisions and outcomes are based on data. There are several key elements 
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associated with the scientific method, and the concepts and techniques of statistics play a 
prominent role in all these elements. 


Making an Observation First, an observation is made of a phenomenon or a 
group of phenomena. This observation leads to the formulation of questions or uncer- 
tainties that can be answered in a scientifically rigorous way. For example, it is readily 
observable that regular exercise reduces body weight in many people. It is also readily 
observable that changing diet may have a similar effect. In this case there are two 
observable phenomena, regular exercise and diet change, that have the same endpoint. 
The nature of this endpoint can be determined by use of the scientific method. 


Formulating a Hypothesis In the second step of the scientific method a 
hypothesis is formulated to explain the observation and to make quantitative predictions 
of new observations. Often hypotheses are generated as a result of extensive background 
research and literature reviews. The objective is to produce hypotheses that are scientifi- 
cally sound. Hypotheses may be stated as either research hypotheses or statistical 
hypotheses. Explicit definitions of these terms are given in Chapter 7, which discusses 
the science of testing hypotheses. Suffice it to say for now that a research hypothesis from 
the weight-loss example would be a statement such as, “Exercise appears to reduce body 
weight." There is certainly nothing incorrect about this conjecture, but it lacks a truly 
quantitative basis for testing. A statistical hypothesis may be stated using quantitative 
terminology as follows: “The average (mean) loss of body weight of people who exercise is 
greater than the average (mean) loss of body weight of people who do not exercise." In this 
statement a quantitative measure, the “average” or “mean” value, is hypothesized to be 
greater in the sample of patients who exercise. The role of the statistician in this step of the 
scientific method is to state the hypothesis in a way that valid conclusions may be drawn 
and to interpret correctly the results of such conclusions. 


Designing an Experiment The third step of the scientific method involves 
designing an experiment that will yield the data necessary to validly test an appropriate 
statistical hypothesis. This step of the scientific method, like that of data analysis, requires 
the expertise of a statistician. Improperly designed experiments are the leading cause of 
invalid results and unjustified conclusions. Further, most studies that are challenged by 
experts are challenged on the basis of the appropriateness or inappropriateness of the 
study's research design. 

Those who properly design research experiments make every effort to ensure that the 
measurement of the phenomenon of interest is both accurate and precise. Accuracy refers 
to the correctness of a measurement. Precision, on the other hand, refers to the consistency 
of a measurement. It should be noted that in the social sciences, the term validity is 
sometimes used to mean accuracy and that reliability is sometimes used to mean precision. 
In the context of the weight-loss example given earlier, the scale used to measure the weight 
of study participants would be accurate if the measurement is validated using a scale that is 
properly calibrated. If, however, the scale is off by +3 pounds, then each participant's 
weight would be 3 pounds heavier; the measurements would be precise in that each would 
be wrong by 4-3 pounds, but the measurements would not be accurate. Measurements that 
are inaccurate or imprecise may invalidate research findings. 
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The design of an experiment depends on the type of data that need to be collected to 
test a specific hypothesis. As discussed in Section 1.2, data may be collected or made 
available through a variety of means. For much scientific research, however, the standard 
for data collection is experimentation. А true experimental design is one in which study 
subjects are randomly assigned to an experimental group (or treatment group) and a control 
group that is not directly exposed to a treatment. Continuing the weight-loss example, a 
sample of 100 participants could be randomly assigned to two conditions using the 
methods of Section 1.4. A sample of 50 of the participants would be assigned to a specific 
exercise program and the remaining 50 would be monitored, but asked not to exercise for a 
specific period of time. At the end of this experiment the average (mean) weight losses of 
the two groups could be compared. The reason that experimental designs are desirable 
is that if all other potential factors are controlled, a cause—effect relationship may be tested; 
that is, all else being equal, we would be able to conclude or fail to conclude that the 
experimental group lost weight as a result of exercising. 

The potential complexity of research designs requires statistical expertise, and 
Chapter 8 highlights some commonly used experimental designs. For a more in-depth 
discussion of research designs, the interested reader may wish to refer to texts by Kuehl (5), 
Keppel and Wickens (6), and Tabachnick and Fidell (7). 


Conclusion In the execution of a research study or experiment, one would hope to 
have collected the data necessary to draw conclusions, with some degree of confidence, 
about the hypotheses that were posed as part of the design. It is often the case that 
hypotheses need to be modified and retested with new data and a different design. 
Whatever the conclusions of the scientific process, however, results are rarely considered 
to be conclusive. That is, results need to be replicated, often a large number of times, before 
scientific credence is granted them. 


EXERCISES 


1.5.1 


1.5.2 


Using the example of weight loss as an endpoint, discuss how you would use the scientific method to 
test the observation that change in diet is related to weight loss. Include all of the steps, including the 
hypothesis to be tested and the design of your experiment. 


Continuing with Exercise 1.5.1, consider how you would use the scientific method to test the 
observation that both exercise and change in diet are related to weight loss. Include all of the steps, 
paying particular attention to how you might design the experiment and which hypotheses would be 
testable given your design. 


1.6 COMPUTERS AND 
BIOSTATISTICAL ANALYSIS 


The widespread use of computers has had a tremendous impact on health sciences research 
in general and biostatistical analysis in particular. The necessity to perform long and 
tedious arithmetic computations as part of the statistical analysis of data lives only in the 
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memory of those researchers and practitioners whose careers antedate the so-called 
computer revolution. Computers can perform more calculations faster and far more 
accurately than can human technicians. The use of computers makes it possible for 
investigators to devote more time to the improvement of the quality of raw data and the 
interpretation of the results. 

The current prevalence of microcomputers and the abundance of available statistical 
software programs have further revolutionized statistical computing. The reader in search 
of a statistical software package may wish to consult The American Statistician, a quarterly 
publication of the American Statistical Association. Statistical software packages are 
regularly reviewed and advertised in the periodical. 

Computers currently on the market are equipped with random number generating 
capabilities. As an alternative to using printed tables of random numbers, investigators may 
use computers to generate the random numbers they need. Actually, the “random” numbers 
generated by most computers are in reality pseudorandom numbers because they are the 
result of a deterministic formula. However, as Fishman (8) points out, the numbers appear 
to serve satisfactorily for many practical purposes. 

The usefulness of the computer in the health sciences is not limited to statistical 
analysis. The reader interested in learning more about the use of computers in the health 
sciences will find the books by Hersh (4), Johns (5), Miller et al. (6), and Saba and 
McCormick (7) helpful. Those who wish to derive maximum benefit from the Internet may 
wish to consult the books Physicians’ Guide to the Internet (13) and Computers т 
Nursing's Nurses' Guide to the Internet (14). Current developments in the use of computers 
in biology, medicine, and related fields are reported in several periodicals devoted to 
the subject. A few such periodicals are Computers in Biology and Medicine, Computers 
and Biomedical Research, International Journal of Bio-Medical Computing, Computer 
Methods and Programs in Biomedicine, Computer Applications in the Biosciences, and 
Computers in Nursing. 

Computer printouts are used throughout this book to illustrate the use of computers in 
biostatistical analysis. The MINITAB, SPSS, R, and SAS? statistical software packages for 
the personal computer have been used for this purpose. 


1.7 SUMMARY 


In this chapter we introduced the reader to the basic concepts of statistics. We defined 
statistics as an area of study concerned with collecting and describing data and with making 
statistical inferences. We defined statistical inference as the procedure by which we reach a 
conclusion about a population on the basis of information contained in a sample drawn 
from that population. We learned that a basic type of sample that will allow us to make valid 
inferences is the simple random sample. We learned how to use a table of random numbers 
to draw a simple random sample from a population. 

The reader is provided with the definitions of some basic terms, such as variable 
and sample, that are used in the study of statistics. We also discussed measurement and 
defined four measurement scales—nominal, ordinal, interval, and ratio. The reader is 
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also introduced to the scientific method and the role of statistics and the statistician in 
this process. 

Finally, we discussed the importance of computers in the performance of the 
activities involved in statistics. 


REVIEW QUESTIONS AND EXERCISES 


1. Explain what is meant by descriptive statistics. 


2. Explain what is meant by inferential statistics. 


3. Define: 
(a) Statistics (b) Biostatistics 
(c) Variable (d) Quantitative variable 
(e) Qualitative variable (f) Random variable 
(g) Population (h) Finite population 
(i) Infinite population (j Sample 
(k) Discrete variable (I) Continuous variable 
(m) Simple random sample (n) Sampling with replacement 


(о) Sampling without replacement 


4. Define the word measurement. 
5. List, describe, and compare the four measurement scales. 
6. For each of the following variables, indicate whether it is quantitative or qualitative and specify the 
measurement scale that is employed when taking measurements on each: 
(a) Class standing of the members of this class relative to each other 
(b) Admitting diagnosis of patients admitted to a mental health clinic 
(c) Weights of babies born in a hospital during a year 
(d) Gender of babies born in a hospital during a year 
(e) Range of motion of elbow joint of students enrolled in a university health sciences curriculum 


(f) Under-arm temperature of day-old infants born in a hospital 


7. For each of the following situations, answer questions a through e: 
(a) What is the sample in the study? 
(b) What is the population? 
(c) What is the variable of interest? 
(d) How many measurements were used in calculating the reported results? 
(e) What measurement scale was used? 


Situation A. A study of 300 households in a small southern town revealed that 20 percent had at least 
one school-age child present. 

Situation B. A study of 250 patients admitted to a hospital during the past year revealed that, on the 
average, the patients lived 15 miles from the hospital. 


8. Consider the two situations given in Exercise 7. For Situation A describe how you would use a 
stratified random sample to collect the data. For Situation B describe how you would use systematic 
sampling of patient records to collect the data. 
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CHAPTER 2 


DESCRIPTIVE STATISTICS 


CHAPTER OVERVIEW 


This chapter introduces a set of basic procedures and statistical measures for 
describing data. Data generally consist of an extensive number of measure- 
ments or observations that are too numerous or complicated to be understood 
through simple observation. Therefore, this chapter introduces several tech- 
niques including the construction of tables, graphical displays, and basic 
statistical computations that provide ways to condense and organize infor- 
mation into a set of descriptive measures and visual devices that enhance the 
understanding of complex data. 


TOPICS 


2.1 
2.2 
2.3 
24 
2.5 
2.6 


INTRODUCTION 

THE ORDERED ARRAY 

GROUPED DATA: THE FREQUENCY DISTRIBUTION 
DESCRIPTIVE STATISTICS: MEASURES OF CENTRAL TENDENCY 
DESCRIPTIVE STATISTICS: MEASURES OF DISPERSION 
SUMMARY 


LEARNING OUTCOMES 


After studying this chapter, the student will 


1. 
2. 
3. 


understand how data can be appropriately organized and displayed. 
understand how to reduce data sets into a few useful, descriptive measures. 


be able to calculate and interpret measures of central tendency, such as the mean, 
median, and mode. 


be able to calculate and interpret measures of dispersion, such as the range, 
variance, and standard deviation. 
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2.1 


INTRODUCTION 


In Chapter 1 we stated that the taking of a measurement and the process of counting yield 
numbers that contain information. The objective of the person applying the tools of 
statistics to these numbers is to determine the nature of this information. This task is made 
much easier if the numbers are organized and summarized. When measurements of a 
random variable are taken on the entities of a population or sample, the resulting values are 
made available to the researcher or statistician as a mass of unordered data. Measurements 
that have not been organized, summarized, or otherwise manipulated are called raw data. 
Unless the number of observations is extremely small, it will be unlikely that these raw data 
will impart much information until they have been put into some kind of order. 

In this chapter we learn several techniques for organizing and summarizing data so 
that we may more easily determine what information they contain. The ultimate in 
summarization of data is the calculation of a single number that in some way conveys 
important information about the data from which it was calculated. Such single numbers 
that are used to describe data are called descriptive measures. After studying this chapter 
you will be able to compute several descriptive measures for both populations and samples 
of data. 

The purpose of this chapter is to equip you with skills that will enable you to 
manipulate the information—in the form of numbers—that you encounter as a health 
Sciences professional. The better able you are to manipulate such information, the better 
understanding you will have of the environment and forces that generate the information. 


2.2 THE ORDERED ARRAY 


A first step in organizing data is the preparation of an ordered array. An ordered array is a 
listing of the values of a collection (either population or sample) in order of magnitude from 
the smallest value to the largest value. If the number of measurements to be ordered is of 
any appreciable size, the use of a computer to prepare the ordered array is highly desirable. 

An ordered array enables one to determine quickly the value of the smallest 
measurement, the value of the largest measurement, and other facts about the arrayed 
data that might be needed in a hurry. We illustrate the construction of an ordered array with 
the data discussed in Example 1.4.1. 


EXAMPLE 2.2.1 


Table 1.4.1 contains a list of the ages of subjects who participated in the study on smoking 
cessation discussed in Example 1.4.1. As can be seen, this unordered table requires 
considerable searching for us to ascertain such elementary information as the age of the 
youngest and oldest subjects. 


Solution: Table 2.2.1 presents the data of Table 1.4.1 in the form of an ordered array. By 
referring to Table 2.2.1 we are able to determine quickly the age of the 
youngest subject (30) and the age of the oldest subject (82). We also readily 
note that about one-third of the subjects are 50 years of age or younger. 
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TABLE 2.2.1 Ordered Array of Ages of Subjects from Table 1.4.1 


30 34 35 37 37 38 38 38 38 39 39 40 40 42 42 
43 43 43 43 43 43 44 44 44 44 44 44 44 45 45 
45 46 46 46 46 46 46 47 47 47 47 47 47 48 48 
48 48 48 48 48 49 49 49 49 49 49 49 50 50 50 
50 50 50 50 50 51 51 51 51 52 52 52 52 52 52 
53 53 53 53 53 53 53 53 53 53 53 53 53 53 53 
53 53 54 54 54 54 54 54 54 54 54 54 54 55 55 
55 56 56 56 56 56 56 57 57 57 57 57 57 57 58 
58 59 59 59 59 59 59 60 60 60 60 61 61 61 61 
61 61 61 61 61 61 61 62 62 62 62 62 62 62 63 
63 64 64 64 64 64 64 65 65 66 66 66 66 66 66 
67 68 68 68 69 69 69 70 71 71 71 71 71 71 71 
72 73 75 76 77 78 78 78 82 


Computer Analysis If additional computations and organization of a data set 
have to be done by hand, the work may be facilitated by working from an ordered array. If 
the data are to be analyzed by a computer, it may be undesirable to prepare an ordered array, 
unless one is needed for reference purposes or for some other use. A computer does not 
need for its user to first construct an ordered array before entering data for the construction 
of frequency distributions and the performance of other analyses. However, almost all 
computer statistical packages and spreadsheet programs contain a routine for sorting data 
in either an ascending or descending order. See Figure 2.2.1, for example. 


Dialog box: Session command: 


Data » Sort MTB » Sort C1 C2; 


SUBC> By Cl. 
[sort 
Sort column(s]: 


By column: 
By column: 
By column: 
By column: 


Store sorted data in: 
(* New worksheet 


Name: | [Optional] 


C Original column(s] 


C Column{s) of current worksheet: 


FIGURE 2.2.1 MINITAB dialog box for Example 2.2.1. 
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2.3 GROUPED DATA: THE 
FREQUENCY DISTRIBUTION 


Although a set of observations can be made more comprehensible and meaningful by 
means of an ordered array, further useful summarization may be achieved by grouping the 
data. Before the days of computers one of the main objectives in grouping large data sets 
was to facilitate the calculation of various descriptive measures such as percentages and 
averages. Because computers can perform these calculations on large data sets without first 
grouping the data, the main purpose in grouping data now is summarization. One must bear 
in mind that data contain information and that summarization is a way of making it easier to 
determine the nature of this information. One must also be aware that reducing a large 
quantity of information in order to summarize the data succinctly carries with it the 
potential to inadvertently lose some amount of specificity with regard to the underlying 
data set. Therefore, it is important to group the data sufficiently such that the vast amounts 
of information are reduced into understandable summaries. At the same time data should 
be summarized to the extent that useful intricacies in the data are not readily obvious. 

To group a set of observations we select a set of contiguous, nonoverlapping intervals 
such that each value in the set of observations can be placed in one, and only one, of the 
intervals. These intervals are usually referred to as class intervals. 

One of the first considerations when data are to be grouped is how many intervals to 
include. Too few intervals are undesirable because of the resulting loss of information. On 
the other hand, if too many intervals are used, the objective of summarization will not be 
met. The best guide to this, as well as to other decisions to be made in grouping data, is your 
knowledge of the data. It may be that class intervals have been determined by precedent, as 
in the case of annual tabulations, when the class intervals of previous years are maintained 
for comparative purposes. A commonly followed rule of thumb states that there should be 
no fewer than five intervals and no more than 15. If there are fewer than five intervals, the 
data have been summarized too much and the information they contain has been lost. If 
there are more than 15 intervals, the data have not been summarized enough. 

Those who need more specific guidance in the matter of deciding how many class 
intervals to employ may use a formula given by Sturges (1). This formula gives 
k = 1 + 3.322(log,o n), where К stands for the number of class intervals and n is the 
number of values in the data set under consideration. The answer obtained by applying 
Sturges's rule should not be regarded as final, but should be considered as a guide only. The 
number of class intervals specified by the rule should be increased or decreased for 
convenience and clear presentation. 

Suppose, for example, that we have a sample of 275 observations that we want to 
group. The logarithm to the base 10 of 275 is 2.4393. Applying Sturges's formula gives 
k = 1 + 3.322(2.4393) ~ 9. In practice, other considerations might cause us to use eight 
or fewer or perhaps 10 or more class intervals. 

Another question that must be decided regards the width of the class intervals. Class 
intervals generally should be of the same width, although this is sometimes impossible to 
accomplish. This width may be determined by dividing the range by k, the number of class 
intervals. Symbolically, the class interval width is given by 

R 


wae (2.3.1) 
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where R (the range) is the difference between the smallest and the largest observation in the 
data set, and k is defined as above. As a rule this procedure yields a width that is 
inconvenient for use. Again, we may exercise our good judgment and select a width 
(usually close to one given by Equation 2.3.1) that is more convenient. 

There are other rules of thumb that are helpful in setting up useful class intervals. 
When the nature of the data makes them appropriate, class interval widths of 5 units, 10 
units, and widths that are multiples of 10 tend to make the summarization more 
comprehensible. When these widths are employed it is generally good practice to have 
the lower limit of each interval end in a zero or 5. Usually class intervals are ordered from 
smallest to largest; that is, the first class interval contains the smaller measurements and the 
last class interval contains the larger measurements. When this is the case, the lower limit 
of the first class interval should be equal to or smaller than the smallest measurement in the 
data set, and the upper limit of the last class interval should be equal to or greater than the 
largest measurement. 

Most statistical packages allow users to interactively change the number of class 
intervals and/or the class widths, so that several visualizations of the data can be obtained 
quickly. This feature allows users to exercise their judgment in deciding which data display 
is most appropriate for a given purpose. Let us use the 189 ages shown in Table 1.4.1 and 
arrayed in Table 2.2.1 to illustrate the construction of a frequency distribution. 


EXAMPLE 2.3.1 


We wish to know how many class intervals to have in the frequency distribution of the data. 
We also want to know how wide the intervals should be. 


Solution: To get an idea as to the number of class intervals to use, we can apply 
Sturges's rule to obtain 


k = 1 +3.322(log 189) 
1 + 3.322(2.2764618) 


де 
^2 


Now let us divide the range by 9 to get some idea about the class 
interval width. We have 


К 82-30 52 
= = — = 5.778 
k 9 9 


It is apparent that a class interval width of 5 or 10 will be more 
convenient to use, as well as more meaningful to the reader. Suppose we 
decide on 10. We may now construct our intervals. Since the smallest value in 
Table 2.2.1 is 30 and the largest value is 82, we may begin our intervals with 
30 and end with 89. This gives the following intervals: 


30-39 
40-49 
50-59 
60-69 
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70—79 
80—89 


We see that there are six of these intervals, three fewer than the number 
suggested by Sturges's rule. 

It is sometimes useful to refer to the center, called the midpoint, of a 
class interval. The midpoint of a class interval is determined by obtaining the 
sum of the upper and lower limits of the class interval and dividing by 2. 
Thus, for example, the midpoint of the class interval 30—39 is found to be 
(30 + 39)/2 = 34.5. B 


When we group data manually, determining the number of values falling into each 
class interval is merely a matter of looking at the ordered array and counting the number 
of observations falling in the various intervals. When we do this for our example, we 
have Table 2.3.1. 

A table such as Table 2.3.1 is called a frequency distribution. 'This table shows the 
way in which the values of the variable are distributed among the specified class intervals. 
By consulting it, we can determine the frequency of occurrence of values within any one of 
the class intervals shown. 


Relative Frequencies It may be useful at times to know the proportion, rather 
than the number, of values falling within a particular class interval. We obtain this 
information by dividing the number of values in the particular class interval by the total 
number of values. If, in our example, we wish to know the proportion of values between 50 
and 59, inclusive, we divide 70 by 189, obtaining .3704. Thus we say that 70 out of 189, or 
70/189ths, or .3704, of the values are between 50 and 59. Multiplying .3704 by 100 gives us 
the percentage of values between 50 and 59. We can say, then, that 37.04 percent of the 
subjects are between 50 and 59 years of age. We may refer to the proportion of values 
falling within a class interval as the relative frequency of occurrence of values in that 
interval. In Section 3.2 we shall see that a relative frequency may be interpreted also as the 
probability of occurrence within the given interval. This probability of occurrence is also 
called the experimental probability or the empirical probability. 


TABLE 2.3.1 Frequency Distribution of 
Ages of 189 Subjects Shown in Tables 1.4.1 


and 2.2.1 

Class Interval Frequency 
30-39 11 
40-49 46 
50-59 70 
60-69 45 
70-79 16 
80-89 1 


Total 189 
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TABLE 2.3.2 Frequency, Cumulative Frequency, Relative Frequency, 
and Cumulative Relative Frequency Distributions of the Ages of Subjects 
Described in Example 1.4.1 


Cumulative 
Class Cumulative Relative Relative 
Interval Frequency Frequency Frequency Frequency 
30-39 11 11 .0582 .0582 
40-49 46 57 .2434 .3016 
50-59 70 127 .3704 .6720 
60-69 45 172 .2381 .9101 
70-79 16 188 .0847 .9948 
80-89 1 189 .0053 1.0001 


Total 189 1.0001 


Note: Frequencies do not add to 1.0000 exactly because of rounding. 


In determining the frequency of values falling within two or more class intervals, we 
obtain the sum of the number of values falling within the class intervals of interest. 
Similarly, if we want to know the relative frequency of occurrence of values falling within 
two or more class intervals, we add the respective relative frequencies. We may sum, or 
cumulate, the frequencies and relative frequencies to facilitate obtaining information 
regarding the frequency or relative frequency of values within two or more contiguous 
class intervals. Table 2.3.2 shows the data of Table 2.3.1 along with the cumulative 
frequencies, the relative frequencies, and cumulative relative frequencies. 

Suppose that we are interested in the relative frequency of values between 50 and 79. 
We use the cumulative relative frequency column of Table 2.3.2 and subtract .3016 from 
.9948, obtaining .6932. 

We may use a statistical package to obtain a table similar to that shown in Table 2.3.2. 
Tables obtained from both MINITAB and SPSS software are shown in Figure 2.3.1. 


The Histogram We may display a frequency distribution (or a relative frequency 
distribution) graphically in the form of a histogram, which is a special type of bar graph. 

When we construct a histogram the values of the variable under consideration are 
represented by the horizontal axis, while the vertical axis has as its scale the frequency (or 
relative frequency if desired) of occurrence. Above each class interval on the horizontal 
axis a rectangular bar, or cell, as it is sometimes called, is erected so that the height 
corresponds to the respective frequency when the class intervals are of equal width. The 
cells of a histogram must be joined and, to accomplish this, we must take into account the 
true boundaries of the class intervals to prevent gaps from occurring between the cells of 
our graph. 

The level of precision observed in reported data that are measured on a continuous 
scale indicates some order of rounding. The order of rounding reflects either the reporter's 
personal preference or the limitations of the measuring instrument employed. When a 
frequency distribution is constructed from the data, the class interval limits usually reflect 
the degree of precision of the raw data. This has been done in our illustrative example. 
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Dialog box: Session command: 


Stat » Tables » Tally Individual Variables MTB » Tally C2; 
SUBC» Counts; 

Type C2 in Variables. Check Counts, Percents, SUBC>  CumCounts; 

Cumulative counts, and Cumulative percents in SUBC> Percents; 

Display. Click OK. SUBC>  CumPercents; 


Output: 


Tally for Discrete Variables: C2 
MINITAB Output SPSS Output 


C2 Count CumCnt Percent CumPct Valid | Cumulative 
11 ДУ: 5.82 5.82 Frequency | Percent |Percent Percent 
46 57 24.34 30.16 Valid 30-39 1i ; : 5. 
70 127 37.04 67.20 40-49 46 : К 30. 
45 172 23.81 91.01 50-59 70 . E 67. 
16 188 8.47 99.47 60569 2 | . 91. 


1 189 0.53 100.00 Mns 1e 
80-89 1 
189 


Total 189 


FIGURE 2.3.1 Frequency, cumulative frequencies, percent, and cumulative percent 
distribution of the ages of subjects described in Example 1.4.1 as constructed by MINITAB and 
SPSS. 


We know, however, that some of the values falling in the second class interval, for example, 
when measured precisely, would probably be a little less than 40 and some would be a little 
greater than 49. Considering the underlying continuity of our variable, and assuming that 
the data were rounded to the nearest whole number, we find it convenient to think of 39.5 
and 49.5 as the true limits of this second interval. The true limits for each of the class 
intervals, then, we take to be as shown in Table 2.3.3. 

If we construct a graph using these class limits as the base of our rectangles, no gaps 
will result, and we will have the histogram shown in Figure 2.3.2. We used MINITAB to 
construct this histogram, as shown in Figure 2.3.3. 

We refer to the space enclosed by the boundaries of the histogram as the area of the 
histogram. Each observation is allotted one unit of this area. Since we have 189 
observations, the histogram consists of a total of 189 units. Each cell contains a certain 
proportion of the total area, depending on the frequency. The second cell, for example, 
contains 46/189 of the area. This, as we have learned, is the relative frequency of 
occurrence of values between 39.5 and 49.5. From this we see that subareas of the 
histogram defined by the cells correspond to the frequencies of occurrence of values 
between the horizontal scale boundaries of the areas. The ratio of a particular subarea to the 
total area of the histogram is equal to the relative frequency of occurrence of values 
between the corresponding points on the horizontal axis. 
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TABLE 2.3.3 The Data of 70 
Table 2.3.1 Showing True Class 
Limits 60 
True Class Limits Frequency 50 
> 
29.5-39.5 11 © 40 
39.5-49.5 46 e 
o 30 
49.5-59.5 70 [m 
59.5-69.5 45 20 
69.5-79.5 16 
79.5-89.5 1 10 
Total 189 0 | | | І | 


34.5 44.5 54.5 64.5 74.5 84.5 
Аде 
FIGURE 2.3.2 Histogram of ages of 
189 subjects from Table 2.3.1. 


The Frequency Polygon A frequency distribution can be portrayed graphically 
in yet another way by means of a frequency polygon, which is a special kind of line graph. 
To draw a frequency polygon we first place a dot above the midpoint of each class interval 
represented on the horizontal axis of a graph like the one shown in Figure 2.3.2. The height 
of a given dot above the horizontal axis corresponds to the frequency of the relevant class 
interval. Connecting the dots by straight lines produces the frequency polygon. Figure 2.3.4 
is the frequency polygon for the age data in Table 2.2.1. 

Note that the polygon is brought down to the horizontal axis at the ends at points that 
would be the midpoints if there were an additional cell at each end of the corresponding 
histogram. This allows for the total area to be enclosed. The total area under the frequency 
polygon is equal to the area under the histogram. Figure 2.3.5 shows the frequency polygon 
of Figure 2.3.4 superimposed on the histogram of Figure 2.3.2. This figure allows you to 
see, for the same set of data, the relationship between the two graphic forms. 


Dialog box: Session command: 


Graph » Histogram » Simple » OK В > Histogram 'Age'; 
BC> MidPoint 34.5:84.5/10; 
Type Age in Graph Variables: Click OK. BC> Bar. 


Now double click the histogram and click Binning Tab. 
Type 34.5:84.5/10 in MidPoint/CutPoint positions: 
Click OK. 


FIGURE 2.3.3 МІМІТАВ dialog box and session command for constructing histogram from 
data on ages in Example 1.4.1. 
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70 707 
60 60r 
50 50r 
3 5 
= 40 = 40r- 
Ф Ф 
æ) pm { 
o o 
о 30 © 30r- 
LL LL 
20 20r 
10 10r 
0 | | | | | 0 | І І І І 
24.5 34.5 44.5 54.5 64.5 74.5 84.5 94.5 24.5 34.5 44.5 54.5 64.5 74.5 84.5 94.5 
Age Age 
FIGURE 2.3.4 Frequency polygon for the ages of FIGURE 2.3.5 Histogram and frequency polygon 
189 subjects shown in Table 2.2.1. for the ages of 189 subjects shown in Table 2.2.1. 


Stem-and-Leaf Displays Another graphical device that is useful for represent- 
ing quantitative data sets is the stem-and-leaf display. A stem-and-leaf display bears a 
strong resemblance to a histogram and serves the same purpose. A properly constructed 
stem-and-leaf display, like a histogram, provides information regarding the range of the 
data set, shows the location of the highest concentration of measurements, and reveals the 
presence or absence of symmetry. An advantage of the stem-and-leaf display over the 
histogram is the fact that it preserves the information contained in the individual 
measurements. Such information is lost when measurements are assigned to the class 
intervals of a histogram. As will become apparent, another advantage of stem-and-leaf 
displays is the fact that they can be constructed during the tallying process, so the 
intermediate step of preparing an ordered array is eliminated. 

To construct a stem-and-leaf display we partition each measurement into two parts. 
The first part is called the stem, and the second part is called the leaf. The stem consists of 
one or more of the initial digits of the measurement, and the leaf is composed of one or 
more of the remaining digits. All partitioned numbers are shown together in a single 
display; the stems form an ordered column with the smallest stem at the top and the largest 
at the bottom. We include in the stem column all stems within the range of the data even 
when a measurement with that stem is not in the data set. The rows of the display contain 
the leaves, ordered and listed to the right of their respective stems. When leaves consist of 
more than one digit, all digits after the first may be deleted. Decimals when present in the 
original data are omitted in the stem-and-leaf display. The stems are separated from their 
leaves by a vertical line. Thus we see that a stem-and-leaf display is also an ordered array of 
the data. 

Stem-and-leaf displays are most effective with relatively small data sets. As a rule 
they are not suitable for use in annual reports or other communications aimed at the general 
public. They are primarily of value in helping researchers and decision makers understand 
the nature of their data. Histograms are more appropriate for externally circulated 
publications. The following example illustrates the construction of a stem-and-leaf display. 
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Stem Leaf 


04577888899 

0022333333444444455566666677777788888889999999 
0000000011112222223333333333333333344444444444555666666777777788999999 
000011111111111222222233444444556666667888999 

0111111123567888 

2 
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FIGURE 2.3.6 Stem-and-leaf display of ages of 189 subjects shown in Table 2.2.1 (stem 
unit — 10, leaf unit — 1). 


EXAMPLE 2.3.2 


Let us use the age data shown in Table 2.2.1 to construct a stem-and-leaf display. 


Solution: Since the measurements are all two-digit numbers, we will have one-digit 
stems and one-digit leaves. For example, the measurement 30 has a stem of 3 
and a leaf of 0. Figure 2.3.6 shows the stem-and-leaf display for the data. 

The MINITAB statistical software package may be used to construct 
stem-and-leaf displays. The MINITAB procedure and output are as shown in 
Figure 2.3.7. The increment subcommand specifies the distance from one 
stem to the next. The numbers in the leftmost output column of Figure 2.3.7 


Dialog box: Session command: 


Graph » Stem-and-Leaf MTB » Stem-and-Leaf 'Age'; 
SUBC» Increment 10. 


Type Age in Graph Variables. Type /0 in Increment. 
Click OK. 


Output: 


Stem-and-Leaf Display: Age 


Stem-and-leaf of Age 
Leaf Unit = 1.0 


11 04577888899 
57 0022333333444444455566666677777788888889999999 
(70) 00000000111122222233333333333333333444444444445556666667777777889+ 
62 000011111111111222222233444444556666667888999 
17 0111111123567888 
T 2 


FIGURE 2.3.7 Stem-and-leaf display prepared by MINITAB from the data on subjects’ ages 
shown in Table 2.2.1. 
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Stem-and-leaf of Age 
Leaf Unit = 1.0 


2 
11 
28 
57 


(46) 
86 
62 
32 
17 

7 
1 


3 04 

577888899 

00223333334444444 
55566666677777788888889999999 
0000000011112222223333333333333333344444444444 
555666666777777788999999 
000011111111111222222233444444 
556666667888999 

0111111123 

567888 

2 
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FIGURE 2.3.8 Stem-and-leaf display prepared by MINITAB from the data on subjects’ ages 
shown in Table 2.2.1; class interval width — 5. 


provide information regarding the number of observations (leaves) on a given 
line and above or the number of observations on a given line and below. For 
example, the number 57 on the second line shows that there are 57 
observations (or leaves) on that line and the one above it. The number 62 
on the fourth line from the top tells us that there are 62 observations on that 
line and all the ones below. The number in parentheses tells us that there are 
70 observations on that line. The parentheses mark the line containing the 
middle observation if the total number of observations is odd or the two 
middle observations if the total number of observations is even. 

The + at the end of the third line in Figure 2.3.7 indicates that the 
frequency for that line (age group 50 through 59) exceeds the line capacity, 
and that there is at least one additional leaf that is not shown. In this case, the 
frequency for the 50—59 age group was 70. The line contains only 65 leaves, 
so the 4- indicates that there are five more leaves, the number 9, that are not 
shown. E 


One way to avoid exceeding the capacity of a line is to have more lines. This is 
accomplished by making the distance between lines shorter, that is, by decreasing the 
widths of the class intervals. For the present example, we may use class interval widths of 5, 
so that the distance between lines is 5. Figure 2.3.8 shows the result when MINITAB is used 
to produce the stem-and-leaf display. 


EXERCISES 


2.3.1 Ina study of the oral home care practice and reasons for seeking dental care among individuals on 
renal dialysis, Atassi (A-1) studied 90 subjects on renal dialysis. The oral hygiene status of all 
subjects was examined using a plaque index with a range of 0 to 3 (0 = no soft plaque deposits, 


2.3.2 
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3 — an abundance of soft plaque deposits). The following table shows the plaque index scores for all 

90 subjects. 
117 2.50 2.00 233 1.67 133 
117 217 217 133 2.17 2.00 
2.17 1.47 2.50 200 1.50 1.50 
100 2.17 2.17 167 200 2.00 
1.33 217 283 1.50 2.50 2.33 
0.33 2.17 183 200 217 2.00 
100 217 2.17 133 2.17 2.50 
0.83 117 2.17 250 2.00 2.50 
0.50 1.50 2.00 2.00 2.00 2.00 
117 1.33 1.67 2.17 1.50 2.00 
1.67 0.33 1.50 2.17 2.33 2.33 
1.17 000 1.50 2.33 1.83 2.67 
0.83 117 150 2.17 2.67 1.50 
2.00 2.17 1.33 2.00 2.33 2.00 
2.17 217 200 217 200 2.17 
Source: Data provided courtesy of Farhad 
Atassi, DDS, MSc, FICOL 


(a) Use these data to prepare: 
A frequency distribution 
A relative frequency distribution 
A cumulative frequency distribution 
A cumulative relative frequency distribution 
A histogram 
A frequency polygon 


(b) What percentage of the measurements are less than 2.00? 

(c) What proportion of the subjects have measurements greater than or equal to 1.50? 
(d) What percentage of the measurements are between 1.50 and 1.99 inclusive? 

(e) How many of the measurements are greater than 2.49? 

(f) What proportion of the measurements are either less than 1.0 or greater than 2.49? 


(g) Someone picks a measurement at random from this data set and asks you to guess the value. 
What would be your answer? Why? 

(h) Frequency distributions and their histograms may be described in a number of ways depending 
on their shape. For example, they may be symmetric (the left half is at least approximately a mirror 
image of the right half), skewed to the left (the frequencies tend to increase as the measurements 
increase in size), skewed to the right (the frequencies tend to decrease as the measurements increase 
in size), or U-shaped (the frequencies are high at each end of the distribution and small in the center). 
How would you describe the present distribution? 


Janardhan et al. (A-2) conducted a study in which they measured incidental intracranial aneurysms 
(IAs) in 125 patients. The researchers examined postprocedural complications and concluded that 
IAs can be safely treated without causing mortality and with a lower complications rate than 
previously reported. The following are the sizes (in millimeters) of the 159 IIAs in the sample. 


8.1 10.0 5.0 7.0 10.0 3.0 
20.0 4.0 4.0 6.0 6.0 7.0 
(Continued ) 
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10.0 4.0 3.0 5.0 6.0 6.0 
6.0 6.0 6.0 5.0 4.0 5.0 
60 25.0 10.0 140 6.0 6.0 
4.0 15.0 5.0 5.0 8.0 19.0 

21.0 8.3 7.0 8.0 5.0 8.0 
5.0 7.5 70 10.0 15.0 8.0 

10.0 3.0 15.0 6.0 10.0 8.0 
7.0 5.0 10.0 3.0 7.0 3:3 

15.0 5.0 5.0 3.0 7.0 8.0 
3.0 6.0 6.0 100 15.0 6.0 
3.0 3.0 7.0 5.0 4.0 9.2 

16.0 7.0 8.0 5.0 00 10.0 
9.0 5.0 5.0 4.0 8.0 4.0 
3.0 4.0 5.0 80 300 140 

15.0 2.0 8.0 70 12.0 4.0 
38 10.0 25.0 8.0 9.0 14.0 

30.0 2.0 10.0 5.0 5.0 10.0 

22.0 5.0 5.0 3.0 4.0 8.0 
7.5 5.0 8.0 3.0 5.0 7.0 
8.0 5.0 9.0 11.0 2.0 10.0 
6.0 5.0 5.0 12.0 9.0 8.0 

15.0 180 100 9.0 5.0 6.0 
6.0 80 120 10.0 5.0 
5.0 16.0 8.0 5.0 8.0 
40 16.0 3.0 70 13.0 


Source: Data provided courtesy of 
Vallabh Janardhan, M.D. 


(a) Use these data to prepare: 
A frequency distribution 
A relative frequency distribution 
A cumulative frequency distribution 
A cumulative relative frequency distribution 
A histogram 
A frequency polygon 
(b) What percentage of the measurements are between 10 and 14.9 inclusive? 
(c) How many observations are less than 20? 
(d) What proportion of the measurements are greater than or equal to 25? 
(e) What percentage of the measurements are either less than 10.0 or greater than 19.95? 


(f) Refer to Exercise 2.3.1, part h. Describe the distribution of the size of the aneurysms in this sample. 


2.3.3 Hoekema et al. (A-3) studied the craniofacial morphology of patients diagnosed with obstructive 
sleep apnea syndrome (OSAS) in healthy male subjects. One of the demographic variables the 
researchers collected for all subjects was the Body Mass Index (calculated by dividing weight in kg 
by the square of the patient’s height in cm). The following are the BMI values of 29 OSAS subjects. 


33.57 27.78 40.81 
38.34 29.01 47.78 


26.86 54.33 28.99 
(Continued ) 
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2521 
36.42 
24.54 
24.49 
29.07 
26.54 
31.44 


30.49 
41.50 


41.75 
33.23 
28.21 


27.74 


30.08 


27.38 
29.39 
44.68 
47.09 
42.10 
33.48 


Source: Data provided courtesy 
of A. Hoekema, D.D.S. 


(a) Use these data to construct: 


A frequency distribution 
A relative frequency distribution 


A cumulative frequency distribution 


A cumulative relative frequency distribution 


A histogram 
A frequency polygon 


(b) What percentage of the measurements are less than 30? 
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(c) What percentage of the measurements are between 40.0 and 49.99 inclusive? 


(d) What percentage of the measurements are greater than 34.99? 
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(e) Describe these data with respect to symmetry and skewness as discussed in Exercise 2.3.1, part h. 


(f) How many of the measurements are less than 40? 


David Holben (A-4) studied selenium levels in beef raised in a low selenium region of the United 
States. The goal of the study was to compare selenium levels in the region-raised beef to selenium 
levels in cooked venison, squirrel, and beef from other regions of the United States. The data below 
are the selenium levels calculated on a dry weight basis in .g/100 є for a sample of 53 region-raised 


cattle. 


11.23 
29.63 
20.42 
10.12 
39.91 
32.66 
38.38 
36.21 
16.39 
27.44 
17.29 
56.20 
28.94 
20.11 
25.35 
21.77 
31.62 
32.63 
30.31 
46.16 


15.82 
27.74 
22.35 
34.78 
35.09 
32.60 
37.03 
27.00 
44.20 
13.09 
33.03 

9.69 
32.45 
37.38 
34.91 
27.99 
22.36 
22.68 
26.52 
46.01 
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56.61 38.04 
24.47 30.88 
29.39 30.04 
40.71 25.91 
18.52 18.54 
27.80 25.51 
19.49 


Source: Data provided courtesy 
of David Holben, Ph.D. 


(a) Use these data to construct: 

A frequency distribution 

A relative frequency distribution 

A cumulative frequency distribution 

A cumulative relative frequency distribution 

A histogram 

A frequency polygon 
(b) Describe these data with respect to symmetry and skewness as discussed in Exercise 2.3.1, part h. 
(c) How many of the measurements are greater than 40? 


(d) What percentage of the measurements are less than 25? 


2.3.5 The following table shows the number of hours 45 hospital patients slept following the administration 
of a certain anesthetic. 


7 10 12 4 8 7 3 8 5 
12 11 3 8 1 1 13 10 4 
4 5 5 8 Tid el 3 2 3 
8 13 1 7 17 3 4 5 5 
3 1 17 10 a. i: 7 1 8 


(a) From these data construct: 


A frequency distribution 

A relative frequency distribution 
A histogram 

A frequency polygon 


(b) Describe these data relative to symmetry and skewness as discussed in Exercise 2.3.1, part h. 
2.3.6 The following are the number of babies born during a year in 60 community hospitals. 


30 55 27 45 56 48 45 49 32 57 47 56 
37 55 52 34 54 42 32 59 35 46 24 57 
32 26 40 28 53 54 29 42 42 54 53 59 
39 56 59 58 49 53 30 53 21 34 28 50 
52 57 43 46 54 31 22 31 24 24 57 29 


(a) From these data construct: 
A frequency distribution 
A relative frequency distribution 
A histogram 
A frequency polygon 


(b) Describe these data relative to symmetry and skewness as discussed in Exercise 2.3.1, part h. 
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2.3.7 Ina study of physical endurance levels of male college freshman, the following composite endurance 
Scores based on several exercise routines were collected. 


2.3.8 


2.3.9 


254 
182 
180 
198 
222 
165 
265 
220 
272 
232 
214 
218 
169 
191 
251 
188 


281 
210 
188 
190 
187 
194 
222 
201 
195 
191 
278 
213 
187 
124 
206 
195 


192 
235 
135 
151 
134 
206 
264 
203 
227 
175 
252 
172 
204 
199 
173 
240 


(a) From these data construct: 


A frequency distribution 


260 
239 
233 
157 
193 
193 
249 
172 
230 
236 
283 
159 
180 
235 
236 
163 


A relative frequency distribution 
A frequency polygon 
A histogram 


212 
258 
220 
204 
264 
218 
175 
234 
168 
152 
205 
203 
261 
139 
215 
208 


179 
166 
204 
238 
312 
198 
205 
198 
232 
258 
184 
212 
236 
231 
228 


225 
159 
219 
205 
214 
241 
252 
173 
217 
155 
172 
117 
217 
116 
183 


179 
223 
211 
229 
227 
149 
210 
187 
249 
215 
228 
197 
205 
182 
204 


181 
186 
245 
191 
190 
164 
178 
189 
196 
197 
193 
206 
212 
243 
186 


149 
190 
151 
200 
212 
225 
159 
237 
223 
210 
130 
198 
218 
217 
134 


(b) Describe these data relative to symmetry and skewness as discussed in Exercise 2.3.1, part h. 


The following are the ages of 30 patients seen in the emergency room of a hospital on a Friday night. 
Construct a stem-and-leaf display from these data. Describe these data relative to symmetry and 
skewness as discussed in Exercise 2.3.1, part h. 


35 
36 
45 
36 
22 


32 
12 
23 
45 
38 


21 
54 
64 
55 
35 


43 
45 
10 
44 
56 


39 
37 
34 
55 
45 


60 
53 
22 
46 
57 


The following are the emergency room charges made to a sample of 25 patients at two city hospitals. 
Construct a stem-and-leaf display for each set of data. What does a comparison of the two displays 
suggest regarding the two hospitals? Describe the two sets of data with respect to symmetry and 
skewness as discussed in Exercise 2.3.1, part h. 


Hospital A 
249.10 202.50 222.20 214.40 205.90 
214.30 195.10 213.30 225.50 191.40 
201.20 239.80 245.70 213.00 238.80 
171.10 222.00 212.50 201.70 184.90 
248.30 209.70 233.90 229.80 217.90 
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2.3.10 


2.3.11 


Hospital B 
199.50 184.00 173.20 186.00 214.10 
125.50 143.50 190.40 152.00 165.70 
154.70 145.30 154.60 190.30 135.40 
167.70 203.40 186.70 155.30 195.90 
168.90 166.70 178.60 150.20 212.40 


Refer to the ages of patients discussed in Example 1.4.1 and displayed in Table 1.4.1. 


(a) Use class interval widths of 5 and construct: 


A frequency distribution 
A relative frequency distribution 


A cumulative frequency distribution 


A cumulative relative frequency distribution 


A histogram 
A frequency polygon 


(b) Describe these data with respect to symmetry and skewness as discussed in Exercise 2.3.1, part h. 


The objectives of a study by Skjelbo et al. (A-5) were to examine (a) the relationship between 
chloroguanide metabolism and efficacy in malaria prophylaxis and (b) the mephenytoin metabolism 
and its relationship to chloroguanide metabolism among Tanzanians. From information provided 
by urine specimens from the 216 subjects, the investigators computed the ratio of unchanged 


S-mephenytoin to R-mephenytoin (S/R ratio). The results were as follows: 


0.0269 
0.0760 
0.0990 
0.0990 
0.0990 
0.0990 
0.1050 
0.1190 
0.1460 
0.1550 
0.1690 
0.1810 
0.2070 
0.2390 
0.2470 
0.2710 
0.2990 
0.3400 
0.3630 
0.4090 
0.4300 
0.4680 
0.5340 
0.5930 


0.0400 
0.0850 
0.0990 
0.0990 
0.0990 
0.0990 
0.1050 
0.1200 
0.1480 
0.1570 
0.1710 
0.1880 
0.2100 
0.2400 
0.2540 
0.2800 
0.3000 
0.3440 
0.3660 
0.4090 
0.4360 
0.4810 
0.5340 
0.6010 


0.0550 
0.0870 
0.0990 
0.0990 
0.0990 
0.0990 
0.1080 
0.1230 
0.1490 
0.1600 
0.1720 
0.1890 
0.2100 
0.2420 
0.2570 
0.2800 
0.3070 
0.3480 
0.3830 
0.4100 
0.4370 
0.4870 
0.5460 
0.6240 


0.0550 
0.0870 
0.0990 
0.0990 
0.0990 
0.0990 
0.1080 
0.1240 
0.1490 
0.1650 
0.1740 
0.1890 
0.2140 
0.2430 
0.2600 
0.2870 
0.3100 
0.3490 
0.3900 
0.4160 
0.4390 
0.4910 
0.5480 
0.6280 


0.0650 
0.0880 
0.0990 
0.0990 
0.0990 
0.0990 
0.1090 
0.1340 
0.1500 
0.1650 
0.1780 
0.1920 
0.2150 
0.2450 
0.2620 
0.2880 
0.3110 
0.3520 
0.3960 
0.4210 
0.4410 
0.4980 
0.5480 
0.6380 


0.0670 
0.0900 
0.0990 
0.0990 
0.0990 
0.1000 
0.1090 
0.1340 
0.1500 
0.1670 
0.1780 
0.1950 
0.2160 
0.2450 
0.2650 
0.2940 
0.3140 
0.3530 
0.3990 
0.4260 
0.4410 
0.5030 
0.5490 
0.6600 


0.0700 
0.0900 
0.0990 
0.0990 
0.0990 
0.1020 
0.1090 
0.1370 
0.1500 
0.1670 
0.1790 
0.1970 
0.2260 
0.2460 
0.2650 
0.2970 
0.3190 
0.3570 
0.4080 
0.4290 
0.4430 
0.5060 
0.5550 
0.6720 


0.0720 
0.0990 
0.0990 
0.0990 
0.0990 
0.1040 
0.1160 
0.1390 
0.1540 
0.1677 
0.1790 
0.2010 
0.2290 
0.2460 
0.2680 
0.2980 
0.3210 
0.3630 
0.4080 
0.4290 
0.4540 
0.5220 
0.5920 
0.6820 
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0.6870 0.6900 0.6910 0.6940 0.7040 0.7120 0.7200 0.7280 
0.7860 0.7950 0.8040 0.8200 0.8350 0.8770 0.9090 0.9520 
0.9530 0.9830 0.9890 1.0120 1.0260 1.0320 1.0620 1.1600 


Source: Data provided courtesy of Erik Skjelbo, M.D. 


(a) From these data construct the following distributions: frequency, relative frequency, cumulative 
frequency, and cumulative relative frequency; and the following graphs: histogram, frequency 
polygon, and stem-and-leaf plot. 


(b) Describe these data with respect to symmetry and skewness as discussed in Exercise 2.3.1, part h. 


(c) The investigators defined as poor metabolizers of mephenytoin any subject with an S/R 
mephenytoin ratio greater than .9. How many and what percentage of the subjects were poor 
metabolizers? 

(d) How many and what percentage of the subjects had ratios less than .7? Between .3 and .6999 
inclusive? Greater than .4999? 


Schmidt et al. (A-6) conducted a study to investigate whether autotransfusion of shed mediastinal 
blood could reduce the number of patients needing homologous blood transfusion and reduce the 
amount of transfused homologous blood if fixed transfusion criteria were used. The following table 
shows the heights in centimeters of the 109 subjects of whom 97 were males. 


1.720 1710 1.700 1.655 1.800 1.700 
1.730 1.700 1.820 1.810 1.720 1.800 
1.800 1.800 1.790 1.820 1.800 1.650 
1.680 1.730 1.820 1.720 1.710 1.850 
1.760 1.780 1.760 1.820 1.840 1.690 
1.770 1.920 1.690 1.690 1.780 1.720 
1.750 1.710 1.600 1.520 1.805 1.780 
1.820 1.790 1.760 1.830 1.760 1.800 
1.700 1.760 1.750 1.630 1.760 1.770 
1.840 1.690 1.640 1.760 1.850 1.820 
1.760 1.700 1.720 1.780 1.630 1.650 
1.660 1.880 1.740 1.900 1.830 

1.600 1.800 1.670 1.780 1.800 

1.750 1.610 1.840 1.740 1.750 

1.960 1.760 1.730 1.730 1.810 

1.810 1.775 1.710 1.730 1.740 

1.790 1.880 1.730 1.560 1.820 

1.780 1.630 1.640 1.600 1.800 

1.800 1.780 1.840 1.830 

1.770 1.690 1.800 1.620 


Source: Data provided courtesy of Erik Skjelbo, M.D. 


(a) For these data construct the following distributions: frequency, relative frequency, cumulative 
frequency, and cumulative relative frequency; and the following graphs: histogram, frequency 
polygon, and stem-and-leaf plot. 


(b) Describe these data with respect to symmetry and skewness as discussed in Exercise 2.3.1, part h. 
(c) How do you account for the shape of the distribution of these data? 

(d) How tall were the tallest 6.42 percent of the subjects? 

(e) How tall were the shortest 10.09 percent of the subjects? 
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2.4 DESCRIPTIVE STATISTICS: 
MEASURES OF CENTRAL TENDENCY 


Although frequency distributions serve useful purposes, there are many situations that 
require other types of data summarization. What we need in many instances is the ability to 
summarize the data by means of a single number called a descriptive measure. Descriptive 
measures may be computed from the data of a sample or the data of a population. To 
distinguish between them we have the following definitions: 


DEFINITIONS 


1. Adescriptive measure computed from the data of a sample is called a 
statistic. 

2. A descriptive measure computed from the data of a population is 
called a parameter. 


Several types of descriptive measures can be computed from a set of data. In this 
chapter, however, we limit discussion to measures of central tendency and measures of 
dispersion. We consider measures of central tendency in this section and measures of 
dispersion in the following one. 

In each of the measures of central tendency, of which we discuss three, we have a 
single value that is considered to be typical of the set of data as a whole. Measures of central 
tendency convey information regarding the average value of a set of values. As we will see, 
the word average can be defined in different ways. 

The three most commonly used measures of central tendency are the mean, the 
median, and the mode. 


Arithmetic Mean The most familiar measure of central tendency is the arithmetic 
mean. It is the descriptive measure most people have in mind when they speak of the 
"average." The adjective arithmetic distinguishes this mean from other means that can be 
computed. Since we are not covering these other means in this book, we shall refer to the 
arithmetic mean simply as the mean. The mean is obtained by adding all the values in a 
population or sample and dividing by the number of values that are added. 


EXAMPLE 2.4.1 


We wish to obtain the mean age of the population of 189 subjects represented in Table 1.4.1. 
Solution: We proceed as follows: 


48 + 35+ 46+... + 73 + 66 
mean age — i els Sa у = 55.032 
189 B 


The three dots in the numerator represent the values we did not show in order to save 
space. 


2.4 DESCRIPTIVE STATISTICS: MEASURES OF CENTRAL TENDENCY 39 


General Formula for the Mean It will be convenient if we can generalize the 
procedure for obtaining the mean and, also, represent the procedure in a more compact 
notational form. Let us begin by designating the random variable of interest by the capital 
letter X. In our present illustration we let X represent the random variable, age. Specific 
values of a random variable will be designated by the lowercase letter x. To distinguish one 
value from another, we attach a subscript to the x and let the subscript refer to the first, the 
second, the third value, and so on. For example, from Table 1.4.1 we have 


xj = 48, x? = 35, e y X189 — 66 


In general, a typical value of a random variable will be designated by x; and the final value, 
in a finite population of values, by xy, where N is the number of values in the population. 
Finally, we will use the Greek letter u to stand for the population mean. We may now write 
the general formula for a finite population mean as follows: 


N 
x 
i=1 
= 2.4.1 
и N ( ) 


The symbol Sm instructs us to add all values of the variable from the first to the last. This 
symbol У, called the summation sign, will be used extensively in this book. When from the 
context it is obvious which values are to be added, the symbols above and below > will be 
omitted. 


The Sample Mean When we compute the mean for a sample of values, the 
procedure just outlined is followed with some modifications in notation. We use x to 
designate the sample mean and л to indicate the number of values in the sample. The 
sample mean then is expressed as 


(2.4.2) 


EXAMPLE 2.4.2 


In Chapter 1 we selected a simple random sample of 10 subjects from the population of 
subjects represented in Table 1.4.1. Let us now compute the mean age of the 10 subjects in 
our sample. 


Solution: We recall (see Table 1.4.2) that the ages of the 10 subjects in our sample were 
ХІ 43, X2 66, X3 61, Хд 64, X5 65, X6 38, X7 59, Xg 57, 
Xo = 57, хід = 50. Substitution of our sample data into Equation 2.4.2 gives 


Era зб Ж 
no 10 es || 
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Properties of the Mean Тһе arithmetic mean possesses certain properties, some 
desirable and some not so desirable. These properties include the following: 


1. Uniqueness. For a given set of data there is one and only one arithmetic mean. 
2. Simplicity. The arithmetic mean is easily understood and easy to compute. 


3. Since each and every value in a set of data enters into the computation of the mean, it 
is affected by each value. Extreme values, therefore, have an influence on the mean 
and, in some cases, can so distort it that it becomes undesirable as a measure of 
central tendency. 


As an example of how extreme values may affect the mean, consider the following 
situation. Suppose the five physicians who practice in an area are surveyed to determine 
their charges for a certain procedure. Assume that they report these charges: $75, $75, $80, 
$80, and $280. The mean charge for the five physicians is found to be $118, a value that is 
not very representative of the set of data as a whole. The single atypical value had the effect 
of inflating the mean. 


Median The median of a finite set of values is that value which divides the set into 
two equal parts such that the number of values equal to or greater than the median is 
equal to the number of values equal to or less than the median. If the number of values is 
odd, the median will be the middle value when all values have been arranged in order of 
magnitude. When the number of values is even, there is no single middle value. Instead 
there are two middle values. In this case the median is taken to be the mean of these two 
middle values, when all values have been arranged in the order of their magnitudes. In 
other words, the median observation of a data set is the (n+ 1)/2th one when the 
observation have been ordered. If, for example, we have 11 observations, the median is 
the (11 4- 1)/2 — 6th ordered observation. If we have 12 observations the median is the 
(12 + 1)/2 = 6.5th ordered observation and is a value halfway between the 6th and 7th 
ordered observations. 


EXAMPLE 2.4.3 

Let us illustrate by finding the median of the data in Table 2.2.1. 

Solution: The values are already ordered so we need only to find the two middle values. 
The middle value is the (n + 1)/2 = (189 + 1)/2 = 190/2 = 95th one. 


Counting from the smallest up to the 95th value we see that it is 54. 
Thus the median age of the 189 subjects is 54 years. E 


EXAMPLE 2.4.4 


We wish to find the median age of the subjects represented in the sample described in 
Example 2.4.2. 


Solution:  Arraying the 10 ages in order of magnitude from smallest to largest gives 38, 
43, 50, 57, 57, 59, 61, 64, 65, 66. Since we have an even number of ages, there 
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is no middle value. The two middle values, however, are 57 and 59. The 
median, then, is (57 4- 59)/2 — 58. ш 


Properties of the Median Properties of the median include the following: 


1. Uniqueness. As is true with the mean, there is only one median for a given set of 
data. 


2. Simplicity. The median is easy to calculate. 


3. It is not as drastically affected by extreme values as is the mean. 


The Mode The mode of a set of values is that value which occurs most frequently. If 
all the values are different there is no mode; on the other hand, a set of values may have 
more than one mode. 


EXAMPLE 2.4.5 


Find the modal age of the subjects whose ages are given in Table 2.2.1. 


Solution: A count of the ages in Table 2.2.1 reveals that the age 53 occurs most 
frequently (17 times). The mode for this population of ages is 53. и 


For ап example of а set of values that has more than one mode, let us consider 
a laboratory with 10 employees whose ages are 20, 21, 20, 20, 34, 22, 24, 27, 27, 
and 27. We could say that these data have two modes, 20 and 27. The sample 
consisting of the values 10, 21, 33, 53, and 54 has no mode since all the values are 
different. 

The mode may be used also for describing qualitative data. For example, suppose the 
patients seen in a mental health clinic during a given year received one of the following 
diagnoses: mental retardation, organic brain syndrome, psychosis, neurosis, and personal- 
ity disorder. The diagnosis occurring most frequently in the group of patients would be 
called the modal diagnosis. 

An attractive property of a data distribution occurs when the mean, median, and 
mode are all equal. The well-known “bell-shaped curve” is a graphical representation of 
a distribution for which the mean, median, and mode are all equal. Much statistical 
inference is based on this distribution, the most common of which is the normal 
distribution. The normal distribution is introduced in Section 4.6 and discussed further 
in subsequent chapters. Another common distribution of this type is the t-distribution, 
which is introduced in Section 6.3. 


Skewness Data distributions may be classified on the basis of whether they are 
symmetric or asymmetric. If a distribution is symmetric, the left half of its graph 
(histogram or frequency polygon) will be a mirror image of its right half. When the 
left half and right half of the graph of a distribution are not mirror images of each other, the 
distribution is asymmetric. 
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Frequency 


DEFINITION 

If the graph (histogram or frequency polygon) of a distribution is 
asymmetric, the distribution is said to be skewed . If a distribution is 

not symmetric because its graph extends further to the right than to 

the left, that is, if it has a long tail to the right, we say that the distribution 
is skewed to the right or is positively skewed. lf a distribution is not 
symmetric because its graph extends further to the left than to the right, 
that is, if it has a long tail to the left, we say that the distribution is 
skewed to the left or is negatively skewed. 


A distribution will be skewed to the right, or positively skewed, if its mean is greater 
than its mode. A distribution will be skewed to the left, or negatively skewed, if its mean is 
less than its mode. Skewness can be expressed as follows: 


vaba- уту (а 30) 
Skewness = з = 337 E три (2.4.3) 
(5 И з") (п —1)уп—1 


In Equation 2.4.3, s is the standard deviation of a sample as defined in Equation 2.5.4. Most 
computer statistical packages include this statistic as part of a standard printout. A value of 
skewness > 0 indicates positive skewness and a value of skewness < 0 indicates negative 
skewness. An illustration of skewness is shown in Figure 2.4.1. 


EXAMPLE 2.4.6 


Consider the three distributions shown in Figure 2.4.1. Given that the histograms represent 
frequency counts, the data can be easily re-created and entered into a statistical package. 
For example, observation of the *No Skew" distribution would yield the following data: 
5, 5, 6, 6, 6, 7, 7, 7, 7, 8, 8, 8, 8, 8, 9, 9, 9, 9, 10, 10, 10, 11, 11. Values can be obtained from 


No Skew Right Skew Left Skew 
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FIGURE 2.4.1 Three histograms illustrating skewness. 
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the skewed distributions in a similar fashion. Using SPSS software, the following 
descriptive statistics were obtained for these three distributions 


No Skew Right Skew Left Skew 


Mean 8.0000 6.6667 8.3333 
Median 8.0000 6.0000 9.0000 
Mode 8.00 5.00 10.00 
Skewness .000 .627 —.627 


2.5 DESCRIPTIVE STATISTICS: 
MEASURES OF DISPERSION 


The dispersion of a set of observations refers to the variety that they exhibit. A measure of 
dispersion conveys information regarding the amount of variability present in a set of data. 
If all the values are the same, there is no dispersion; if they are not all the same, dispersion is 
present in the data. The amount of dispersion may be small when the values, though 
different, are close together. Figure 2.5.1 shows the frequency polygons for two popula- 
tions that have equal means but different amounts of variability. Population B, which is 
more variable than population A, is more spread out. If the values are widely scattered, the 
dispersion is greater. Other terms used synonymously with dispersion include variation, 
spread, and scatter. 


The Range One way to measure the variation in a set of values is to compute the 
range. The range is the difference between the largest and smallest value in a set of 
observations. If we denote the range by К, the largest value by xr, and the smallest value 
by xs, we compute the range as follows: 


EX UM (2.5.1) 


Mm Р 
м, Population B 
^^ 


` 
e LLL А В Я У N 
mí 


FIGURE 2.5.1 Two frequency distributions with equal means but different amounts 
of dispersion. 
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EXAMPLE 2.5.1 


We wish to compute the range of the ages of the sample subjects discussed in Table 2.2.1. 


Solution: Since the youngest subject in the sample is 30 years old and the oldest is 82, 
we compute the range to be 


R=82-30= 52 и 


The usefulness of the range is limited. The fact that it takes into account only two values 
causes it to be a poor measure of dispersion. The main advantage in using the range is the 
simplicity of its computation. Since the range, expressed as a single measure, imparts 
minimal information about a data set and therefore is of limited use, it is often preferable to 
express the range as a number pair, [xs, x; ], in which хз and ху, are the smallest and largest 
values in the data set, respectively. For the data in Example 2.5.1, we may express the range 
as the number pair [30, 82]. Although this is not the traditional expression for the range, it is 
intuitive to imagine that knowledge of the minimum and maximum values in this data set 
would convey more information than knowing only that the range is equal to 52. An infinite 
number of distributions, each with quite different minimum and maximum values, may 
have a range of 52. 


The Variance When the values of a set of observations lie close to their mean, the 
dispersion is less than when they are scattered over a wide range. Since this is true, it would 
be intuitively appealing if we could measure dispersion relative to the scatter of the values 
about their mean. Such a measure is realized in what is known as the variance. In 
computing the variance of a sample of values, for example, we subtract the mean from each 
of the values, square the resulting differences, and then add up the squared differences. This 
sum of the squared deviations of the values from their mean is divided by the sample size, 
minus 1, to obtain the sample variance. Letting s? stand for the sample variance, the 
procedure may be written in notational form as follows: 


У (ох? 
СРЕ CA (2.5.2) 


It is therefore easy to see that the variance can be described as the average squared 
deviation of individual values from the mean of that set. It may seem nonintuitive at this 
stage that the differences in the numerator be squared. However, consider a symmetric 
distribution. It is easy to imagine that if we compute the difference of each data point in the 
distribution from the mean value, half of the differences would be positive and half would 
be negative, resulting in a sum that would be zero. A variance of zero would be a 
noninformative measure for any distribution of numbers except one in which all of the 
values are the same. Therefore, the square of each difference is used to ensure a positive 
numerator and hence a much more valuable measure of dispersion. 


EXAMPLE 2.5.2 


Let us illustrate by computing the variance of the ages of the subjects discussed in 
Example 2.4.2. 
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Solution: СЕС ы 56)? + (66 — 56)? +- - - (50 — 56)? 
810 * 
= ——=90 
9 a 


Degrees of Freedom The reason for dividing by n — 1 rather than п, as we might 
have expected, is the theoretical consideration referred to as degrees of freedom. In 
computing the variance, we say that we have n — 1 degrees of freedom. We reason as 
follows. The sum of the deviations of the values from their mean is equal to zero, as can be 
shown. If, then, we know the values of n — 1 of the deviations from the mean, we know the 
nth one, since it is automatically determined because of the necessity for all n values to add 
to zero. From a practical point of view, dividing the squared differences by n — 1 rather than 
n is necessary in order to use the sample variance in the inference procedures discussed 
later. The concept of degrees of freedom will be revisited in a later chapter. Students 
interested in pursuing the matter further at this time should refer to the article by Walker (2). 

When we compute the variance from a finite population of N values, the procedures 
outlined above are followed except that we subtract и from each x and divide by М rather 
than N — 1. If we let o? stand for the finite population variance, the formula is as follows: 


дані ______ (2.5.3) 


Standard Deviation The variance represents squared units and, therefore, is not 
an appropriate measure of dispersion when we wish to express this concept in terms of the 
original units. To obtain a measure of dispersion in original units, we merely take the square 
root of the variance. The result is called the standard deviation. In general, the standard 
deviation of a sample is given by 


з = Мз? = (2.5.4) 


The standard deviation of a finite population is obtained by taking the square root of the 
quantity obtained by Equation 2.5.3, and is represented by o. 


The Coefficient of Variation The standard deviation is useful as a measure of 
variation within a given set of data. When one desires to compare the dispersion in two sets 
of data, however, comparing the two standard deviations may lead to fallacious results. It 
may be that the two variables involved are measured in different units. For example, we 
may wish to know, for a certain population, whether serum cholesterol levels, measured in 
milligrams per 100 ml, are more variable than body weight, measured in pounds. 

Furthermore, although the same unit of measurement is used, the two means may be 
quite different. If we compare the standard deviation of weights of first-grade children with 
the standard deviation of weights of high school freshmen, we may find that the latter 
standard deviation is numerically larger than the former, because the weights themselves 
are larger, not because the dispersion is greater. 


46  CHAPTER2 DESCRIPTIVE STATISTICS 


What is needed in situations like these is a measure of relative variation rather than 
absolute variation. Such a measure is found in the coefficient of variation, which expresses 
the standard deviation as a percentage of the mean. The formula is given by 


C.V. = =(100)% (2.5.5) 


We see that, since the mean and standard deviations are expressed in the same unit of 
measurement, the unit of measurement cancels out in computing the coefficient of 
variation. What we have, then, is a measure that is independent of the unit of measurement. 


EXAMPLE 2.5.3 


Suppose two samples of human males yield the following results: 


Sample 1 Sample 2 
Age 25 years 11 years 
Mean weight 145 pounds 80 pounds 
Standard deviation 10 pounds 10 pounds 


We wish to know which is more variable, the weights of the 25-year-olds or the weights of 
the 11-year-olds. 


Solution: А comparison of the standard deviations might lead one to conclude that the 
two samples possess equal variability. If we compute the coefficients of 
variation, however, we have for the 25-year-olds 


10 
EM. = 145 (100) = 6.9% 
and for the 11-year-olds 
10 
С.У. = — (100) = 12.5 
30 | ) ^ 


If we compare these results, we get quite a different impression. It is clear 
from this example that variation is much higher in the sample of 11-year-olds 
than in the sample of 25-year-olds. A 


The coefficient of variation is also useful in comparing the results obtained by 
different persons who are conducting investigations involving the same variable. Since the 
coefficient of variation is independent of the scale of measurement, itis a useful statistic for 
comparing the variability of two or more variables measured on different scales. We could, 
for example, use the coefficient of variation to compare the variability in weights of one 
sample of subjects whose weights are expressed in pounds with the variability in weights of 
another sample of subjects whose weights are expressed in kilograms. 


2.5 DESCRIPTIVE STATISTICS: MEASURES OF DISPERSION 47 


Variable N N* Mean SE Mean StDev Minimum Q1 Median Q3 Maximum 


cl 10 0 56.00 3.00 9.49 38.00 48.25 58.00 64.25 66.00 


FIGURE 2.5.2 Printout of descriptive measures computed from the sample of ages in 
Example 2.4.2, MINITAB software package. 


Computer Analysis Computer software packages provide a variety of possibilit- 
les in the calculation of descriptive measures. Figure 2.5.2 shows a printout of the 
descriptive measures available from the MINITAB package. The data consist of the 
ages from Example 2.4.2. 

In the printout О, and О» are the first and third quartiles, respectively. These 
measures are described later in this chapter. N stands for the number of data observations, 
and N* stands for the number of missing values. The term SEMEAN stands for standard 
error of the mean. This measure will be discussed in detail in a later chapter. Figure 2.5.3 
shows, for the same data, the SAS® printout obtained by using the PROC MEANS 
statement. 


Percentiles and Quartiles The mean and median are special cases of a family 
of parameters known as location parameters. These descriptive measures are called 
location parameters because they can be used to designate certain positions on the 
horizontal axis when the distribution of a variable is graphed. In that sense the so-called 
location parameters "locate" the distribution on the horizontal axis. For example, a 
distribution with a median of 100 is located to the right of a distribution with a median 
of 50 when the two distributions are graphed. Other location parameters include percentiles 
and quartiles. We may define a percentile as follows: 


DEFINITION 


Given a set of п observations хі, x2, . . . Xn, the pth percentile P is the 
value of X such that p percent or less of the observations are less than P 
and (100 — p) percent or less of the observations are greater than P. 


The MEANS Procedure 


Analysis Variable: Age 


Mean Std Dev Minimum Maximum 
56.0000000 9.4868330 38.0000000 66.0000000 


Coeff of 
Std Error Sum Variance Variation 
3.0000000 560.0000000 90.0000000 16.9407732 


FIGURE 2.5.3 Printout of descriptive measures computed from the sample of ages in 
Example 2.4.2, SAS? software package. 
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Subscripts on P serve to distinguish one percentile from another. The 10th percentile, 
for example, is designated Ро, the 70th is designated P79, and so on. The 50th percentile is 
the median and is designated P59. The 25th percentile is often referred to as the first quartile 
and denoted Q,. The 50th percentile (the median) is referred to as the second or middle 
quartile and written О», and the 75th percentile is referred to as the third quartile, О». 

When we wish to find the quartiles for a set of data, the following formulas are used: 


1 
О, = a th ordered observation 
2(n4-1 1 
Q = -о = 15 th ordered observation (2.5.6) 
3(n+1 
О; = а) th ordered observation 


It should be noted that the equations shown in 2.5.6 determine the positions of the quartiles 
in a data set, not the values of the quartiles. It should also be noted that though there is a 
universal way to calculate the median (05), there are a variety of ways to calculate Q,, and 
Q» values. For example, SAS provides for a total of five different ways to calculate the 
quartile values, and other programs implement even different methods. For a discussion of 
the various methods for calculating quartiles, interested readers are referred to the article 
by Hyndman and Fan (3). To illustrate, note that the printout in MINITAB in Figure 2.5.2 
shows О, = 48.25 and Оз = 64.25, whereas program R yields the values О, = 52.75 and 
Оз = 63.25. 


Interquartile Range As we have seen, the range provides a crude measure of 
the variability present in a set of data. A disadvantage of the range is the fact that it is 
computed from only two values, the largest and the smallest. A similar measure that 
reflects the variability among the middle 50 percent of the observations in a data set is 
the interquartile range. 


DEFINITION 
The interquartile range (IQR) is the difference between the third and first 
quartiles: that is, 


IQR = 0, – 0, (2.5.7) 


A large IQR indicates a large amount of variability among the middle 50 percent of the 
relevant observations, and a small IQR indicates a small amount of variability among the 
relevant observations. Since such statements are rather vague, it is more informative to 
compare the interquartile range with the range for the entire data set. A comparison may 
be made by forming the ratio of the IQR to the range (R) and multiplying by 100. That is, 
100 (IQR/R) tells us what percent the IQR is of the overall range. 


Kurtosis Just as we may describe a distribution in terms of skewness, we may 
describe a distribution in terms of kurtosis. 
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DEFINITION 


Kurtosis is a measure of the degree to which a distribution is “peaked” or 
flat in comparison to a normal distribution whose graph is characterized 
by a bell-shaped appearance. 


A distribution, in comparison to a normal distribution, may possesses an excessive 
proportion of observations in its tails, so that its graph exhibits a flattened appearance. 
Such a distribution is said to be platykurtic. Conversely, a distribution, in comparison to a 
normal distribution, may possess a smaller proportion of observations in its tails, so that its 
graph exhibits a more peaked appearance. Such a distribution is said to be leptokurtic. A 
normal, or bell-shaped distribution, is said to be mesokurtic. 

Kurtosis can be expressed as 


n 


ху пУ (s - 3) 


(x 
| 3= 3 (2.5.8) 
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(Ee) 


n 


Kurtosis — 


Manual calculation using Equation 2.5.8 is usually not necessary, since most statistical 
packages calculate and report information regarding kurtosis as part of the descriptive 
statistics for a data set. Note that each of the two parts of Equation 2.5.8 has been reduced 
by 3. A perfectly mesokurtic distribution has a kurtosis measure of 3 based on the equation. 
Most computer algorithms reduce the measure by 3, as is done in Equation 2.5.8, so that the 
kurtosis measure of a mesokurtic distribution will be equal to 0. A leptokurtic distribution, 
then, will have a kurtosis measure > 0, and a platykurtic distribution will have a kurtosis 
measure « 0. Be aware that not all computer packages make this adjustment. In such cases, 
comparisons with a mesokurtic distribution are made against 3 instead of against 0. Graphs 
of distributions representing the three types of kurtosis are shown in Figure 2.5.4. 


EXAMPLE 2.5.4 


Consider the three distributions shown in Figure 2.5.4. Given that the histograms represent 
frequency counts, the data can be easily re-created and entered into a statistical package. 
For example, observation of the “mesokurtic” distribution would yield the following data: 
1,2,2,3,3,3,3,3,...,9, 9, 9, 9, 9, 10, 10, 11. Values can be obtained from the other 
distributions in a similar fashion. Using SPSS software, the following descriptive statistics 
were obtained for these three distributions: 


Mesokurtic Leptokurtic Platykurtic 


Mean 6.0000 6.0000 6.0000 
Median 6.0000 6.0000 6.0000 
Mode 6.00 6.00 6.00 
Kurtosis .000 .608 —1.158 
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FIGURE 2.5.4 Three histograms representing kurtosis. 


Box-and-Whisker Plots A useful visual device for communicating the infor- 
mation contained in a data set is the box-and-whisker plot. The construction of a box-and- 
whisker plot (sometimes called, simply, a boxplot) makes use of the quartiles of a data set 
and may be accomplished by following these five steps: 


1. Represent the variable of interest on the horizontal axis. 


2. Draw a box in the space above the horizontal axis in such a way that the left end of the 
box aligns with the first quartile O, and the right end of the box aligns with the third 
quartile Оз. 


3. Divide the box into two parts by a vertical line that aligns with the median О». 


4. Draw a horizontal line called a whisker from the left end of the box to a point that 
aligns with the smallest measurement in the data set. 


5. Draw another horizontal line, or whisker, from the right end of the box to a point that 
aligns with the largest measurement in the data set. 


Examination of a box-and-whisker plot for a set of data reveals information 
regarding the amount of spread, location of concentration, and symmetry of the data. 
The following example illustrates the construction of a box-and-whisker plot. 


EXAMPLE 2.5.5 


Evans et al. (А-7) examined the effect of velocity on ground reaction forces (СВЕ) in 
dogs with lameness from a torn cranial cruciate ligament. The dogs were walked and 
trotted over a force platform, and the GRF was recorded during a certain phase of their 
performance. Table 2.5.1 contains 20 measurements of force where each value shown is 
the mean of five force measurements per dog when trotting. 


TABLE 2.5.1 GRF Measurements When Trotting of 20 Dogs with a Lame 


Ligament 
14.6 24.3 24.9 27.0 27.2 27.4 28.2 28.8 29.9 30.7 


31.5 31.6 32.3 32.8 33.3 33.6 34.3 36.9 38.3 44.0 


Source: Data provided courtesy of Richard Evans, Ph.D. 


Force 
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GRF Measurements 


FIGURE 2.5.5 Box-and-whisker plot for Example 2.5.5. 


Solution: 


The smallest and largest measurements are 14.6 and 44, respectively. The 
first quartile is the О, = (20+ 1)/4 = 5.25th measurement, which is 
27.2 + (.25) (27.4 — 27.2) = 27.25. The median is the Q, + (20 + 1)/2 = 
10.5th measurement ог 30.7 + (.5)(31.5 — 30.7) = 31.1; and the third 
quartile is the Оз + 3(20 + 1)/4 = 15.75th measurement, which is equal 
to 33.3 + (.75)(33.6 - 33.3) = 33.525. The interquartile range is 
IQR — 33.525 — 27.25 — 6.275. The range is 29.4, and the IQR is 
100(6.275/29.4) — 21 percent of the range. The resulting box-and-whisker 
plot is shown in Figure 2.5.5. [| 


Examination of Figure 2.5.5 reveals that 50 percent of the measurements are between 
about 27 and 33, the approximate values of the first and third quartiles, respectively. The 
vertical bar inside the box shows that the median is about 31. 

Many statistical software packages have the capability of constructing box-and- 
whisker plots. Figure 2.5.6 shows one constructed by MINITAB and one constructed by 
NCSS from the data of Table 2.5.1. The procedure to produce the MINTAB plot is shown in 
Figure 2.5.7. The asterisks in Figure 2.5.6 alert us to the fact that the data set contains one 
unusually large and one unusually small value, called outliers. The outliers are the dogs 
that generated forces of 14.6 and 44. Figure 2.5.6 illustrates the fact that box-and-whisker 
plots may be displayed vertically as well as horizontally. 

An outlier, or a typical observation, may be defined as follows. 
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FIGURE 2.5.6 Box-and-whisker plot constructed by MINITAB (left) and by R (right) from the 
data of Table 2.5.1. 
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Dialog box: Session command: 


Stat » EDA » Boxplot » Simple MTB > Boxplot ‘Force’; 


Click OK. SUBC> IQRbox; 
SUBC> Outlier. 

Type Force Graph Variables. 

Click OK. 


FIGURE 2.5.7 MINITAB procedure to produce Figure 2.5.6. 


DEFINITION 


An outlier is an observation whose value, x, either exceeds the value 

of the third quartile by a magnitude greater than 1.5(IQR) or is less than 
the value of the first quartile by a magnitude greater than 1.5(IQR). 
That is, an observation of x > Q} + 1.5(IQR) or an observation of 

x < О, — 1.5(IQR) is called an outlier. 


For the data in Table 2.5.1 we may use the previously computed values of От, Оз, 
and IQR to determine how large or how small a value would have to be in order to be 
considered an outlier. The calculations are as follows: 


х < 27.25 - 1.5(6.275) = 17.8375 and x > 33.525 + 1.5(6.275) = 42.9375 


For the data in Table 2.5.1, then, an observed value smaller than 17.8375 or larger than 
42.9375 would be considered an outlier. 

The SAS? statement PROC UNIVARIATE may be used to obtain a box-and-whisker 
plot. The statement also produces other descriptive measures and displays, including stem- 
and-leaf plots, means, variances, and quartiles. 


Exploratory Data Analysis — Box-and-whisker plots and stem-and-leaf displays 
are examples of what are known as exploratory data analysis techniques. These tech- 
niques, made popular as a result of the work of Tukey (4), allow the investigator to examine 
data in ways that reveal trends and relationships, identify unique features of data sets, and 
facilitate their description and summarization. 


EXERCISES 


For each of the data sets in the following exercises compute (a) the mean, (b) the median, (c) the 
mode, (d) the range, (e) the variance, (f) the standard deviation, (g) the coefficient of variation, and (h) 
the interquartile range. Treat each data set as a sample. For those exercises for which you think it 
would be appropriate, construct a box-and-whisker plot and discuss the usefulness in understanding 
the nature of the data that this device provides. For each exercise select the measure of central 
tendency that you think would be most appropriate for describing the data. Give reasons to justify 
your choice. 


2.5.1 


2.5.2 


2.5.3 


2.5.4 
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Porcellini et al. (A-8) studied 13 HIV-positive patients who were treated with highly active 
antiretroviral therapy (HAART) for at least 6 months. The CD4 T cell counts (x 106 / L) at baseline 
for the 13 subjects are listed below. 


230 205 313 207 227 245 173 
58 103 181 105 301 169 

Source: Simona Porcellini, Guiliana Vallanti, Silvia Nozza, 
Guido Poli, Adriano Lazzarin, Guiseppe Tambussi, 

Antonio Grassia, “Improved Thymopoietic Potential in 

Aviremic HIV Infected Individuals with HAART by 

Intermittent IL-2 Administration," AIDS, 17 (2003), 

1621—1630. 


Shair and Jasper (A-9) investigated whether decreasing the venous return in young rats would affect 
ultrasonic vocalizations (USVs). Their research showed no significant change in the number of 
ultrasonic vocalizations when blood was removed from either the superior vena cava or the carotid 
artery. Another important variable measured was the heart rate (bmp) during the withdrawal of blood. 
The table below presents the heart rate of seven rat pups from the experiment involving the carotid 
artery. 


500 570 560 570 450 560 570 
Source: Harry N. Shair and Anna Jasper, “Decreased 

Venous Return Is Neither Sufficient nor Necessary to Elicit 
Ultrasonic Vocalization of Infant Rat Pups," Behavioral 
Neuroscience, 117 (2003), 840—853. 


Butz et al. (A-10) evaluated the duration of benefit derived from the use of noninvasive positive- 
pressure ventilation by patients with amyotrophic lateral sclerosis on symptoms, quality of life, and 
survival. One of the variables of interest is partial pressure of arterial carbon dioxide (PaCO;). The 
values below (mm Hg) reflect the result of baseline testing on 30 subjects as established by arterial 
blood gas analyses. 


40.0 47.0 34.0 42.0 54.0 48.0 53.6 56.9 58.0 45.0 
54.5 54.0 43.0 44.3 53.9 41.8 33.0 43.1 52.4 37.9 
34.5 40.1 33.0 59.9 62.6 54.1 45.7 40.6 56.6 59.0 
Source: M. Butz, K. H. Wollinsky, U. Widemuth-Catrinescu, A. Sperfeld, 

S. Winter, H. H. Mehrkens, A. C. Ludolph, and H. Schreiber, "Longitudinal Effects 

of Noninvasive Positive-Pressure Ventilation in Patients with Amyotrophic Lateral 
Sclerosis," American Journal of Medical Rehabilitation, 82 (2003), 597—604. 


According to Starch et al. (A-11), hamstring tendon grafts have been the “weak link” in anterior 
cruciate ligament reconstruction. In a controlled laboratory study, they compared two techniques for 
reconstruction: either an interference screw or a central sleeve and screw on the tibial side. For eight 
cadaveric knees, the measurements below represent the required force (in newtons) at which initial 
failure of graft strands occurred for the central sleeve and screw technique. 


172.5 216.63 212.62 98.97 66.95 239.76 19.57 195.72 
Source: David W. Starch, Jerry W. Alexander, Philip C. Noble, Suraj Reddy, and David M. 
Lintner, “Multistranded Hamstring Tendon Graft Fixation with a Central Four-Quadrant or 
a Standard Tibial Interference Screw for Anterior Cruciate Ligament Reconstruction," The 
American Journal of Sports Medicine, 31 (2003), 338-344. 
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2.5.5 Cardosi et al. (A-12) performed a 4-year retrospective review of 102 women undergoing radical 
hysterectomy for cervical or endometrial cancer. Catheter-associated urinary tract infection was 
observed in 12 of the subjects. Below are the numbers of postoperative days until diagnosis of the 
infection for each subject experiencing an infection. 


16 10 49 15 6 15 
8 19 11 22 13 17 

Source: Richard J. Cardosi, Rosemary Cardosi, Edward 

C. Grendys Jr, James V. Fiorica, and Mitchel S. Hoffman, 

"Infectious Urinary Tract Morbidity with Prolonged 

Bladder Catheterization After Radical Hysterectomy," American 

Journal of Obstetrics and Gynecology, 

189 (2003), 380-384. 


2.5.6 The purpose of a study by Nozawa et al. (A-13) was to evaluate the outcome of surgical repair of pars 
interarticularis defect by segmental wire fixation in young adults with lumbar spondylolysis. The 
authors found that segmental wire fixation historically has been successful in the treatment of 
nonathletes with spondylolysis, but no information existed on the results of this type of surgery in 
athletes. In a retrospective study, the authors found 20 subjects who had the surgery between 1993 and 
2000. For these subjects, the data below represent the duration in months of follow-up care after the 
operation. 


103 68 62 60 60 54 49 44 42 41 
38 36 34 30 19 19 19 19 17 16 


Source: Satoshi Nozawa, Katsuji Shimizu, Kei Miyamoto, and 
Mizuo Tanaka, “Repair of Pars Interarticularis Defect 

by Segmental Wire Fixation in Young Athletes with 
Spondylolysis,” American Journal of Sports Medicine, 31 (2003), 
359-364. 


2.5.7 See Exercise 2.3.1. 
2.5.8 See Exercise 2.3.2. 
2.5.9 See Exercise 2.3.3. 
2.5.10 See Exercise 2.3.4. 
2.5.11 See Exercise 2.3.5. 
2.5.12 See Exercise 2.3.6. 
2.5.13 See Exercise 2.3.7. 


2.5.14 In a pilot study, Huizinga et al. (A-14) wanted to gain more insight into the psychosocial 
consequences for children of a parent with cancer. For the study, 14 families participated in 
semistructured interviews and completed standardized questionnaires. Below is the age of the 
sick parent with cancer (in years) for the 14 families. 


37 48 53 46 42 49 44 

38 32 32 51 51 48 41 
Source: Gea A. Huizinga, Winette T.A. van der Graaf, Annemike 
Visser, Jos S. Dijkstra, and Josette E. H. M. Hoekstra-Weebers, “Psychosocial 
Consequences for Children of a Parent with Cancer,” Cancer Nursing, 26 
(2003), 195-202. 
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2.06 SUMMARY 


In this chapter various descriptive statistical procedures are explained. These include the 
organization of data by means of the ordered array, the frequency distribution, the relative 
frequency distribution, the histogram, and the frequency polygon. The concepts of 
central tendency and variation are described, along with methods for computing their 
more common measures: the mean, median, mode, range, variance, and standard 
deviation. The reader is also introduced to the concepts of skewness and kurtosis, 
and to exploratory data analysis through a description of stem-and-leaf displays and box- 
and-whisker plots. 

We emphasize the use of the computer as a tool for calculating descriptive measures 
and constructing various distributions from large data sets. 


SUMMARY OF FORMULAS FOR CHAPTER 2 


Formula 
Number Name Formula 
2.3.1 Class interval width R 
А уу = — 
using Sturges's Rule 
2.4.1 Mean of a population N 
2% 
_ i=l 
ES 
2.4.2 Skewness n E ш 3 
MAY уту (2) 
Skewness = E 37 = 
А 2 (п—1)у/п— 15 
(Som) 
2.4.2 Mean of a sample Y 
Ta i=1 
n 
2.5.1 Range R = х — х; 
2.5.2 Sample variance y (u x) 
52 — El 
| n—l 
2.3.3 Population variance N 
Y (a — uy 
2 i=l 
o = 
N 


(Continued ) 
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2.5.4 Standard deviation 
2.5.5 Coefficient of variation СУ. = Е (100)% 
X 
2.5.6 Quartile location in Oe 1 
ordered array 14 
O, = 1 
N^ 
3 
Qi = 1 
2.5.7 Interquartile range IQR = О» — О, 
2.5.8 Kurtosis 
Kurtosis — 


Symbol Key | * C.V. — coefficient of variation 
* [OR = Interquartile range 

* k — number of class intervals 

e u = population mean 

* N — population size 

* n — sample size 

* (n — 1) — degrees of freedom 

* О, = first quartile 


• Q, = second quartile = median 


• Q, = third quartile 

• К = range 

* 5 = standard deviation 

e 52 = sample variance 

* о? = population variance 
e x, = і? data observation 
* xj, — largest data point 

* xs — smallest data point 
— sample mean 


X 
* w — class width 
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REVIEW QUESTIONS AND EXERCISES 


1. 


ро лого Ww PF Y DY 


11. 


12. 


Define: 

(a) Stem-and-leaf display (b) Box-and-whisker plot 
(c) Percentile (d) Quartile 

(e) Location parameter (f) Exploratory data analysis 
(g) Ordered array (h) Frequency distribution 
(i) Relative frequency distribution (j) Statistic 

(k) Parameter (1) Frequency polygon 
(m) True class limits (n) Histogram 


Define and compare the characteristics of the mean, the median, and the mode. 
What are the advantages and limitations of the range as a measure of dispersion? 
Explain the rationale for using n — 1 to compute the sample variance. 

What is the purpose of the coefficient of variation? 

What is the purpose of Sturges's rule? 

What is another name for the 50th percentile (second or middle quartile)? 


Describe from your field of study a population of data where knowledge of the central tendency and 
dispersion would be useful. Obtain real or realistic synthetic values from this population and compute 
the mean, median, mode, variance, and standard deviation. 


Collect a set of real, or realistic, data from your field of study and construct a frequency distribution, a 
relative frequency distribution, a histogram, and a frequency polygon. 


Compute the mean, median, mode, variance, and standard deviation for the data in Exercise 9. 


Find an article in a journal from your field of study in which some measure of central tendency and 
dispersion have been computed. 


The purpose of a study by Tam et al. (A-15) was to investigate the wheelchair maneuvering in 
individuals with lower-level spinal cord injury (SCI) and healthy controls. Subjects used a modified 
wheelchair to incorporate a rigid seat surface to facilitate the specified experimental measurements. 
Interface pressure measurement was recorded by using a high-resolution pressure-sensitive mat with 
a spatial resolution of 4 sensors per square centimeter taped on the rigid seat support. During static 
sitting conditions, average pressures were recorded under the ischial tuberosities. The data for 
measurements of the left ischial tuberosity (in mm Hg) for the SCI and control groups are shown 
below. 


Control | 131 115 124 131 122 117 88 114 150 169 


scr | 60 150 130 180 163 130 121 119 130 148 


Source: Eric W. Tam, Arthur F. Mak, Wai Nga Lam, John H. Evans, and York Y. 
Chow, “Pelvic Movement and Interface Pressure Distribution During Manual Wheel- 
chair Propulsion,” Archives of Physical Medicine and Rehabilitation, 84 (2003), 
1466-1472. 


(a) Find the mean, median, variance, and standard deviation for the controls. 


(b) Find the mean, median variance, and standard deviation for the SCI group. 
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13. 


14. 


15. 


(c) Construct a box-and-whisker plot for the controls. 
(d) Construct a box-and-whisker plot for the SCI group. 


(e) Do you believe there is a difference in pressure readings for controls and SCI subjects in this 
study? 


Johnson et al. (A-16) performed a retrospective review of 50 fetuses that underwent open fetal 
myelomeningocele closure. The data below show the gestational age in weeks of the 50 fetuses 
undergoing the procedure. 


25 25 26 27 29 29 29 30 30 31 

32 32 32 33 33 33 33 34 34 34 

35 35 35 35 35 35 35 35 35 36 

36 36 36 36 36 36 36 36 36 36 

36 36 36 36 36 36 36 36 37 37 
Source: Mark P. Johnson, Leslie N. Sutton, Natalie Rintoul, Timothy M. Crom- 
bleholme, Alan W. Flake, Lori J. Howell, Holly L. Hedrick, R. Douglas Wilson, and 


N. Scott Adzick, “Fetal Myelomeningocele Repair: Short-Term Clinical Outcomes,” 
American Journal of Obstetrics and Gynecology, 189 (2003), 482-487. 


(a) Construct a stem-and-leaf plot for these gestational ages. 

(b) Based on the stem-and-leaf plot, what one word would you use to describe the nature of the data? 
(c) Why do you think the stem-and-leaf plot looks the way it does? 

(d) Compute the mean, median, variance, and standard deviation. 


The following table gives the age distribution for the number of deaths in New York State due to 
accidents for residents age 25 and older. 


Number of Deaths 
Age (Years) Due to Accidents 
25-34 393 
35-44 514 
45-54 460 
55-64 341 
65—74 365 
75—84 616 
85-94* 618 


Source: New York State Department of Health, Vital 
Statistics of New York State, 2000, Table 32: Death 
Summary Information by Age. 

*May include deaths due to accident for adults over 
age 94. 


For these data construct a cumulative frequency distribution, a relative frequency distribution, and a 
cumulative relative frequency distribution. 


Krieser et al. (A-17) examined glomerular filtration rate (GFR) in pediatric renal transplant 
recipients. GFR is an important parameter of renal function assessed in renal transplant recipients. 
The following are measurements from 19 subjects of GFR measured with diethylenetriamine penta- 
acetic acid. (Note: some subjects were measured more than once.) 
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18 42 
21 43 
21 43 
23 48 
27 48 
21 51 
30 55 
32 58 
32 60 
32 62 
36 67 
37 68 
41 88 
42 63 


Source: Data provided courtesy of D. M. Z. Krieser, M.D. 


(a) Compute mean, median, variance, standard deviation, and coefficient of variation. 
(b) Construct a stem-and-leaf display. 
(c) Construct a box-and-whisker plot. 


(d) What percentage of the measurements is within one standard deviation of the mean? Two 
standard deviations? Three standard deviations? 


The following are the cystatin C levels (mg/L) for the patients described in Exercise 15 (A-17). 
Cystatin C is a cationic basic protein that was investigated for its relationship to GFR levels. In 
addition, creatinine levels are also given. (Note: Some subjects were measured more than once.) 


Cystatin C (mg/L) Creatinine (mmol/L) 
1.78 4.69 0.35 0.14 
2.16 3.78 0.30 0.11 
1.82 2.24 0.20 0.09 
1.86 4.93 0.17 0.12 
1.75 2.71 0.15 0.07 
1.83 1.76 0.13 0.12 
2.49 2.62 0.14 0.11 
1.69 2.61 0.12 0.07 
1.85 3.65 0.24 0.10 
1.76 2.36 0.16 0.13 
1.25 3.25 0.17 0.09 
1.50 2.01 0.11 0.12 
2.06 2.51 0.12 0.06 
2.34 


Source: Data provided courtesy of D. M. Z. Krieser, M.D. 


(a) For each variable, compute the mean, median, variance, standard deviation, and coefficient of 
variation. 


(b) For each variable, construct a stem-and-leaf display and a box-and-whisker plot. 


(c) Which set of measurements is more variable, cystatin C or creatinine? On what do you base your 
answer? 
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17. 
18. 


19. 


20. 


21. 


22. 


Give three synonyms for variation (variability). 


The following table shows the age distribution of live births in Albany County, New York, for 
2000. 


Mother's Age Number of Live Births 
10-14 7 
15—19 258 
20-24 585 
25-29 841 
30-34 981 
35-39 526 
40-44 99 
45-49" 4 


Source: New York State Department of Health, Annual 
Vital Statistics 2000, Table 7, Live Births by Resident 
County and Mother's Age. 

"May include live births to mothers over age 49. 


For these data construct a cumulative frequency distribution, a relative frequency distribution, and a 
cumulative relative frequency distribution. 


Spivack (A-18) investigated the severity of disease associated with C. difficilie in pediatric inpatients. 
One of the variables they examined was number of days patients experienced diarrhea. The data for 
the 22 subjects in the study appear below. Compute the mean, median, variance, and standard 
deviation. 


2 3 2 1 1 У 2 p | 3 2 


Source: Jordan G. Spivack, Stephen C. Eppes, and Joel D. Klien, 
“Clostridium Difficile-Associated Diarrhea in a Pediatric 
Hospital,” Clinical Pediatrics, 42 (2003), 347-352. 


Express in words the following properties of the sample mean: 

(а) X(x — х)? = a minimum 

(b) nx = Хх 

(c) X(x—-x)20 

Your statistics instructor tells you on the first day of class that there will be five tests during the term. 
From the scores on these tests for each student, the instructor will compute a measure of central 
tendency that will serve as the student's final course grade. Before taking the first test, you must 
choose whether you want your final grade to be the mean or the median of the five test scores. Which 
would you choose? Why? 


Consider the following possible class intervals for use in constructing a frequency distribution of 
serum cholesterol levels of subjects who participated in a mass screening: 


(a) 50-74 (b) 50-74 (c) 50-75 
75-99 75-99 75-100 
100-149 100-124 100-125 


150-174 125-149 125-150 


23. 


24. 


25. 


26. 


27. 


28. 


29. 
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175-199 150-174 150-175 

200—249 175-199 175-200 

250-274 200-224 200-225 

etc. 225-249 225-250 
etc. etc. 


Which set of class intervals do you think is most appropriate for the purpose? Why? State specifically 
for each one why you think the other two are less desirable. 


On a statistics test students were asked to construct a frequency distribution of the blood creatine 
levels (units/liter) for a sample of 300 healthy subjects. The mean was 95, and the standard deviation 
was 40. The following class interval widths were used by the students: 


(a) 1 (d) 15 
(b) 5 (e) 20 
(c) 10 (f) 25 


Comment on the appropriateness of these choices of widths. 


Give a health sciences-related example of a population of measurements for which the mean would 
be a better measure of central tendency than the median. 


Give a health sciences-related example of a population of measurements for which the median would 
be a better measure of central tendency than the mean. 


Indicate for the following variables which you think would be a better measure of central tendency, 
the mean, the median, or mode, and justify your choice: 


(a) Annual incomes of licensed practical nurses in the Southeast. 
(b) Diagnoses of patients seen in the emergency department of a large city hospital. 


(c) Weights of high-school male basketball players. 


Refer to Exercise 2.3.11. Compute the mean, median, variance, standard deviation, first quartile, third 
quartile, and interquartile range. Construct a boxplot of the data. Are the mode, median, and mean 
equal? If not, explain why. Discuss the data in terms of variability. Compare the IQR with the range. 
What does the comparison tell you about the variability of the observations? 


Refer to Exercise 2.3.12. Compute the mean, median, variance, standard deviation, first quartile, third 
quartile, and interquartile range. Construct a boxplot of the data. Are the mode, median, and mean 
equal? If not, explain why. Discuss the data in terms of variability. Compare the IQR with the range. 
What does the comparison tell you about the variability of the observations? 


Thilothammal et al. (A-19) designed a study to determine the efficacy of BCG (bacillus 
Calmette-Guérin) vaccine in preventing tuberculous meningitis. Among the data collected on 
each subject was a measure of nutritional status (actual weight expressed as a percentage of 
expected weight for actual height). The following table shows the nutritional status values of the 
107 cases studied. 


73.3 54.6 82.4 76.5 72.2 73.6 74.0 
80.5 71.0 56.8 80.6 100.0 79.6 67.3 
50.4 66.0 83.0 72.3 55.7 64.1 66.3 
50.9 71.0 76.5 99.6 79.3 76.9 96.0 
64.8 74.0 72.6 80.7 109.0 68.6 73.8 
74.0 72.7 65.9 73.3 84.4 73.2 70.0 
72.8 73.6 70.0 714 76.4 66.3 50.5 
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72.0 97.5 130.0 68.1 86.4 70.0 73.0 
59.7 89.6 76.9 74.6 67.7 91.9 55.0 
90.9 70.5 88.2 70.5 74.0 55.5 80.0 
76.9 78.1 63.4 58.8 92.3 100.0 84.0 
71.4 84.6 123.7 93.7 76.9 79.6 
45.6 92.5 65.6 61.3 64.5 72.7 
77.5 76.9 80.2 76.9 887 78.1 
60.6 59.0 84.7 78.2 72.4 68.3 
67.5 76.9 82.6 85.4 65.7 65.9 


Source: Data provided courtesy of Dr. N. Thilothammal. 


(a) For these data compute the following descriptive measures: mean, median, mode, variance, 
standard deviation, range, first quartile, third quartile, and IQR. 


(b) Construct the following graphs for the data: histogram, frequency polygon, stem-and-leaf plot, 
and boxplot. 


(c) Discuss the data in terms of variability. Compare the IQR with the range. What does the 
comparison tell you about the variability of the observations? 


(d) What proportion of the measurements are within one standard deviation of the mean? Two 
standard deviations of the mean? Three standard deviations of the mean? 


(e) What proportion of the measurements are less than 100? 


(f) What proportion of the measurements are less than 50? 


Exercises for Use with Large Data Sets Available on the Following Website: www.wiley.com/ 


college/daniel 


1. 


Refer to the dataset NCBIRTH800. The North Carolina State Center for Health Statistics and 
Howard W. Odum Institute for Research in Social Science at the University of North Carolina at 
Chapel Hill (A-20) make publicly available birth and infant death data for all children born in the 
state of North Carolina. These data can be accessed at www.irss.unc.edu/ncvital/bfd 1 down.html. 
Records on birth data go back to 1968. This comprehensive data set for the births in 2001 contains 
120,300 records. The data represents a random sample of 800 of those births and selected variables. 
The variables are as follows: 


Variable Label Description 


PLURALITY Number of children born of the pregnancy 


SEX Sex of child (1 — male, 2 — female) 

MAGE Age of mother (years) 

WEEKS Completed weeks of gestation (weeks) 
MARITAL Marital status (1 — married, 2 — not married) 


RACEMOM Race of mother (0 — other non-White, 1 — White, 2 — Black, 3 — American 
Indian, 4 — Chinese, 5 — Japanese, 6 — Hawaiian, 7 — Filipino, 8 — Other 
Asian or Pacific Islander) 

HISPMOM Mother of Hispanic origin (C — Cuban, M — Mexican, N — Non-Hispanic, 
O — other and unknown Hispanic, P — Puerto Rican, S — Central/South 
American, U — not classifiable) 

GAINED Weight gained during pregnancy (pounds) 

SMOKE 0 = mother did not smoke during pregnancy 
] — mother did smoke during pregnancy 
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DRINK 0 = mother did not consume alcohol during pregnancy 
1 = mother did consume alcohol during pregnancy 
TOUNCES Weight of child (ounces) 
TGRAMS Weight of child (grams) 
LOW 0 = infant was not low birth weight 
] — infant was low birth weight 
PREMIE 0 = infant was not premature 


] — infant was premature 
Premature defined at 36 weeks or sooner 


For the variables of MAGE, WEEKS, GAINED, TOUNCES, and TGRAMS: 
Calculate the mean, median, standard deviation, IQR, and range. 

For each, construct a histogram and comment on the shape of the distribution. 
Do the histograms for TOUNCES and TGRAMS look strikingly similar? Why? 
Construct box-and-whisker plots for all four variables. 


Construct side-by-side box-and-whisker plots for the variable of TOUNCES for women who 
admitted to smoking and women who did not admit to smoking. Do you see a difference in birth 
weight in the two groups? Which group has more variability? 


Construct side-by-side box-and-whisker plots for the variable of MAGE for women who are and are 
not married. Do you see a difference in ages in the two groups? Which group has more variability? 
Are the results surprising? 


Calculate the skewness and kurtosis of the data set. What do they indicate? 
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CHAPTER 3 


SOME BASIC PROBABILITY 
CONCEPTS 


CHAPTER OVERVIEW 


Probability lays the foundation for statistical inference. This chapter provides a 
brief overview of the probability concepts necessary for understanding topics 
covered in the chapters that follow. It also provides a context for under- 
standing the probability distributions used in statistical inference, and intro- 
duces the student to several measures commonly found in the medical 
literature (e.g., the sensitivity and specificity of a test). 


TOPICS 


3.1 INTRODUCTION 

3.2 TWO VIEWS OF PROBABILITY: OBJECTIVE AND SUBJECTIVE 
3.3 ELEMENTARY PROPERTIES OF PROBABILITY 

3.4 CALCULATING THE PROBABILITY OF AN EVENT 


3.5 BAYES' THEOREM, SCREENING TESTS, SENSITIVITY, SPECIFICITY, 
AND PREDICTIVE VALUE POSITIVE AND NEGATIVE 


3.6 SUMMARY 


LEARNING OUTCOMES 


After studying this chapter, the student will 

1. understand classical, relative frequency, and subjective probability. 

2. understand the properties of probability and selected probability rules. 
3. be able to calculate the probability of an event. 

4. be able to apply Bayes' theorem when calculating screening test results. 


3.1 INTRODUCTION 


The theory of probability provides the foundation for statistical inference. However, this 
theory, which is a branch of mathematics, is not the main concern of this book, and, 
consequently, only its fundamental concepts are discussed here. Students who desire to 
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pursue this subject should refer to the many books on probability available in most college 
and university libraries. The books by Gut (1), Isaac (2), and Larson (3) are recommended. 
The objectives of this chapter are to help students gain some mathematical ability in the 
area of probability and to assist them in developing an understanding of the more important 
concepts. Progress along these lines will contribute immensely to their success in under- 
standing the statistical inference procedures presented later in this book. 

The concept of probability is not foreign to health workers and is frequently 
encountered in everyday communication. For example, we may hear a physician say 
that a patient has a 50-50 chance of surviving a certain operation. Another physician may 
say that she is 95 percent certain that a patient has a particular disease. A public health 
nurse may say that nine times out of ten a certain client will break an appointment. As these 
examples suggest, most people express probabilities in terms of percentages. In dealing 
with probabilities mathematically, it is more convenient to express probabilities as 
fractions. (Percentages result from multiplying the fractions by 100.) Thus, we measure 
the probability of the occurrence of some event by a number between zero and one. The 
more likely the event, the closer the number is to one; and the more unlikely the event, the 
closer the number is to zero. An event that cannot occur has a probability of zero, and an 
event that is certain to occur has a probability of one. 

Health sciences researchers continually ask themselves if the results of their efforts 
could have occurred by chance alone or if some other force was operating to produce the 
Observed effects. For example, suppose six out of ten patients suffering from some disease 
are cured after receiving a certain treatment. Is such a cure rate likely to have occurred if 
the patients had not received the treatment, or is it evidence of a true curative effect on the 
part of the treatment? We shall see that questions such as these can be answered through the 
application of the concepts and laws of probability. 


3.2 TWO VIEWS OF PROBABILITY: 
OBJECTIVE AND SUBJECTIVE 


Until fairly recently, probability was thought of by statisticians and mathematicians only as 
an objective phenomenon derived from objective processes. 

The concept of objective probability may be categorized further under the headings 
of (1) classical, or a priori, probability, and (2) the relative frequency, or a posteriori, 
concept of probability. 


Classical Probability The classical treatment of probability dates back to the 
17th century and the work of two mathematicians, Pascal and Fermat. Much of this theory 
developed out of attempts to solve problems related to games of chance, such as those 
involving the rolling of dice. Examples from games of chance illustrate very well the 
principles involved in classical probability. For example, if a fair six-sided die is rolled, the 
probability that a 1 will be observed is equal to 1/6 and is the same for the other five faces. 
If a card is picked at random from a well-shuffled deck of ordinary playing cards, the 
probability of picking a heart is 13/52. Probabilities such as these are calculated by the 
processes of abstract reasoning. It is not necessary to roll a die or draw a card to compute 
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these probabilities. In the rolling of the die, we say that each of the six sides is equally likely 
to be observed if there is no reason to favor any one of the six sides. Similarly, if there is no 
reason to favor the drawing of a particular card from a deck of cards, we say that each of the 
52 cards is equally likely to be drawn. We may define probability in the classical sense 
as follows: 


DEFINITION 


If an event can occur in N mutually exclusive and equally likely ways, 
and if m of these possess a trait E, the probability of the occurrence of E 
is equal to m/ У. 


If we read P(E) as “the probability of E,” we may express this definition as 


Р(Е) = ту (3.2.1) 


Relative Frequency Probability The relative frequency approach to prob- 
ability depends on the repeatability of some process and the ability to count the number 
of repetitions, as well as the number of times that some event of interest occurs. In this 
context we may define the probability of observing some characteristic, E, of an event 
as follows: 


DEFINITION 


If some process is repeated a large number of times, n, and if some 
resulting event with the characteristic E occurs m times, the relative 
frequency of occurrence of E, m/n, will be approximately equal to the 
probability of E. 


To express this definition in compact form, we write 
(3.2.2) 
We must keep in mind, however, that, strictly speaking, m/n is only an estimate of P(E). 


Subjective Probability In the early 1950s, L. J. Savage (4) gave considerable 
impetus to what is called the “personalistic” or subjective concept of probability. This view 
holds that probability measures the confidence that a particular individual has in the truth of 
a particular proposition. This concept does not rely on the repeatability of any process. In 
fact, by applying this concept of probability, one may evaluate the probability of an event 
that can only happen once, for example, the probability that a cure for cancer will be 
discovered within the next 10 years. 

Although the subjective view of probability has enjoyed increased attention over the 
years, it has not been fully accepted by statisticians who have traditional orientations. 
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Bayesian Methods Bayesian methods are named in honor of the Reverend 
Thomas Bayes (1702-1761), an English clergyman who had an interest in mathematics. 
Bayesian methods are an example of subjective probability, since it takes into considera- 
tion the degree of belief that one has in the chance that an event will occur. While 
probabilities based on classical or relative frequency concepts are designed to allow for 
decisions to be made solely on the basis of collected data, Bayesian methods make use of 
what are known as prior probabilities and posterior probabilities. 


DEFINITION 


The prior probability of an event is a probability based on prior 
knowledge, prior experience, or results derived from prior 
data collection activity. 


DEFINITION 


The posterior probability of an event is a probability obtained by using 
new information to update or revise a prior probability. 


As more data are gathered, the more is likely to be known about the “true” probability of the 
event under consideration. Although the idea of updating probabilities based on new 
information is in direct contrast to the philosophy behind frequency-of-occurrence proba- 
bility, Bayesian concepts are widely used. For example, Bayesian techniques have found 
recent application in the construction of e-mail spam filters. Typically, the application of 
Bayesian concepts makes use of a mathematical formula called Bayes' theorem. In Section 
3.5 we employ Bayes' theorem in the evaluation of diagnostic screening test data. 


3.3 ELEMENTARY PROPERTIES 
OF PROBABILITY 


In 1933 the axiomatic approach to probability was formalized by the Russian mathemati- 
cian А. М. Kolmogorov (5). The basis of this approach is embodied in three properties from 
which a whole system of probability theory is constructed through the use of mathematical 
logic. The three properties are as follows. 


1. Given some process (or experiment) with n mutually exclusive outcomes (called 
events), E1, E2,..., En, the probability of any event E; is assigned a nonnegative 
number. That is, 


Р(Е) >0 (3.3.1) 


In other words, all events must have a probability greater than or equal to zero, 
a reasonable requirement in view of the difficulty of conceiving of negative prob- 
ability. A key concept in the statement of this property is the concept of mutually 
exclusive outcomes. Two events are said to be mutually exclusive if they cannot occur 
simultaneously. 
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2. The sum of the probabilities of the mutually exclusive outcomes is equal to 1. 
P(Ei) + P(E2) +--+ P(E,) 51 (3.3.2) 


This is the property of exhaustiveness and refers to the fact that the observer of 
a probabilistic process must allow for all possible events, and when all are taken 
together, their total probability is 1. The requirement that the events be mutually 
exclusive is specifying that the events Ej, E», . . . , E, do not overlap; that is, no two of 
them can occur at the same time. 


3. Consider any two mutually exclusive events, E; and Ej. The probability of the 
occurrence of either E; or Е; is equal to the sum of their individual probabilities. 


P(E; + Ej) = P(E) + P(E) (3:33) 


Suppose the two events were not mutually exclusive; that is, suppose they could 
occur at the same time. In attempting to compute the probability of the occurrence of either 
E; or E; the problem of overlapping would be discovered, and the procedure could become 
quite complicated. This concept will be discusses further in the next section. 


3.4 CALCULATING THE PROBABILITY 
OF AN EVENT 


We now make use of the concepts and techniques of the previous sections in calculating the 
probabilities of specific events. Additional ideas will be introduced as needed. 


EXAMPLE 3.4.1 


The primary aim of a study by Carter et al. (A-1) was to investigate the effect of the age at 
onset of bipolar disorder on the course of the illness. One of the variables investigated was 
family history of mood disorders. Table 3.4.1 shows the frequency of a family history of 


TABLE 3.4.1 Frequency of Family History of Mood Disorder by 
Age Group among Bipolar Subjects 


Family History of Mood Disorders Early = 18(E) Later > 18(L) Total 


Negative (4) 28 35 63 
Bipolar disorder (B) 19 38 57 
Unipolar (C) 41 44 85 
Unipolar and bipolar (D) 53 60 113 
Total 141 177 318 


Source: Tasha D. Carter, Emanuela Mundo, Sagar V. Parkh, and James L. Kennedy, 
“Early Age at Onset as a Risk Factor for Poor Outcome of Bipolar Disorder,” Journal of 
Psychiatric Research, 37 (2003), 297-303. 
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mood disorders in the two groups of interest (Early age at onset defined to be 18 years or 
younger and Later age at onset defined to be later than 18 years). Suppose we pick a person 
at random from this sample. What is the probability that this person will be 18 years old 
or younger? 


Solution: For purposes of illustrating the calculation of probabilities we consider this 
group of 318 subjects to be the largest group for which we have an interest. In 
other words, for this example, we consider the 318 subjects as a population. 
We assume that Early and Later are mutually exclusive categories and that the 
likelihood of selecting any one person is equal to the likelihood of selecting 
any other person. We define the desired probability as the number of subjects 
with the characteristic of interest (Early) divided by the total number of 
subjects. We may write the result in probability notation as follows: 


P(E) — number of Early subjects/total number of subjects 
— 141/318 — .4434 || 


Conditional Probability On occasion, the set of “all possible outcomes" may 
constitute a subset of the total group. In other words, the size of the group of interest may be 
reduced by conditions not applicable to the total group. When probabilities are calculated 
with a subset of the total group as the denominator, the result is a conditional probability. 

The probability computed in Example 3.4.1, for example, may be thought of as an 
unconditional probability, since the size of the total group served as the denominator. No 
conditions were imposed to restrict the size of the denominator. We may also think of this 
probability as a marginal probability since one of the marginal totals was used as the 
numerator. 

We may illustrate the concept of conditional probability by referring again to 
Table 3.4.1. 


EXAMPLE 3.4.2 


Suppose we pick a subject at random from the 318 subjects and find that he is 18 years or 
younger (£). What is the probability that this subject will be one who has no family history 
of mood disorders (A)? 


Solution: The total number of subjects is no longer of interest, since, with the selection 
of an Early subject, the Later subjects are eliminated. We may define the 
desired probability, then, as follows: What is the probability that a subject has 
no family history of mood disorders (A), given that the selected subject is 
Early (Е)? This is a conditional probability and is written as P(A | E) in which 
the vertical line is read "given." The 141 Early subjects become the 
denominator of this conditional probability, and 28, the number of Early 
subjects with no family history of mood disorders, becomes the numerator. 
Our desired probability, then, is 


Р(А | E) = 28/141 = .1986 " 
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Joint Probability Sometimes we want to find the probability that a subject picked 
at random from a group of subjects possesses two characteristics at the same time. Such a 
probability is referred to as a joint probability. We illustrate the calculation of a joint 
probability with the following example. 


EXAMPLE 3.4.3 


Let us refer again to Table 3.4.1. What is the probability that a person picked at random 
from the 318 subjects will be Early (E) and will be a person who has no family history of 
mood disorders (A)? 


Solution: The probability we are seeking may be written in symbolic notation as 
P(E N A) in which the symbol N is read either as “intersection” or “and.” The 
statement Е П A indicates the joint occurrence of conditions Е and A. The 
number of subjects satisfying both of the desired conditions is found in 
Table 3.4.1 at the intersection of the column labeled E and the row labeled A 
and is seen to be 28. Since the selection will be made from the total set of 
subjects, the denominator is 318. Thus, we may write the joint probability as 


P(ENA) = 28/318 = .0881 и 


The Multiplication Rule А probability may be computed from other probabili- 
ties. For example, a joint probability may be computed as the product of an appropriate 
marginal probability and an appropriate conditional probability. This relationship is known 
as the multiplication rule of probability. We illustrate with the following example. 


EXAMPLE 3.4.4 


We wish to compute the joint probability of Early age at onset (E) and a negative family 
history of mood disorders (A) from a knowledge of an appropriate marginal probability and 
an appropriate conditional probability. 


Solution: The probability we seek is P(E N A). We have already computed a marginal 
probability, P(E) — 141/318 — .4434, and a conditional probability, 
P(A|E) = 28/141 = .1986. It so happens that these are appropriate marginal 
and conditional probabilities for computing the desired joint probability. We 
may now compute P(ENA)= P(E)P(A|E) = (.4434)(.1986) — .0881. 
This, we note, is, as expected, the same result we obtained earlier for P(E ПА). ва 


We may state the multiplication rule in general terms as follows: For any two events 
A and B, 


Р(АПВ) = P(B)P(A |B), if P(B) £0 (3.4.1) 


For the same two events A and B, the multiplication rule may also be written as 
P(A п В) = Р(А)Р(В |А), if P(A) 4 0. 

We see that through algebraic manipulation the multiplication rule as stated in 
Equation 3.4.1 may be used to find any one of the three probabilities in its statement if the 
other two are known. We may, for example, find the conditional probability P(A | B) by 
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dividing P(A N B) by P(B). This relationship allows us to formally define conditional 
probability as follows. 


DEFINITION 

The conditional probability of A given B is equal to the probability of 
A N B divided by the probability of B, provided the probability of B 
is not zero. 


That is, 


Р(АП В) 


P(A|B) = P(B) 20 (3.4.2) 


We illustrate the use of the multiplication rule to compute a conditional probability with the 
following example. 


EXAMPLE 3.4.5 


We wish to use Equation 3.4.2 and the data in Table 3.4.1 to find the conditional probability, 
P(A|E) 


Solution: According to Equation 3.4.2, 
P(A | E) = P(A г E)/P(E) и 


Earlier we found P(E N A) = P(A N E) = 28/318 = 0881. We have also determined that 
P(E) — 141/318 — .4434. Using these results we are able to compute P(A|E) — 
.0881/.4434 — .1987, which, as expected, is the same result we obtained by using the 
frequencies directly from Table 3.4.1. (The slight discrepancy is due to rounding.) 


The Addition Rule The third property of probability given previously states that 
the probability of the occurrence of either one or the other of two mutually exclusive events 
is equal to the sum of their individual probabilities. Suppose, for example, that we pick a 
person at random from the 318 represented in Table 3.4.1. What is the probability that this 
person will be Early age at onset (E) or Later age at onset (L)? We state this probability 
in symbols as P(E U L), where the symbol U is read either as “union” or “or.” Since the 
two age conditions are mutually exclusive, Р(ЕП Г) = (141/318) + (177/318) = 
.4434 + .5566 = 1. 

What if two events are not mutually exclusive? This case is covered by what is known 
as the addition rule, which may be stated as follows: 


DEFINITION 


Given two events A and B, the probability that event A, or event B, or 
both occur is equal to the probability that event A occurs, plus the 
probability that event B occurs, minus the probability that the events 
occur simultaneously. 
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The addition rule may be written 


P(A ОВ) = P(A) + P(B) — P(A N B) (3.4.3) 


When events А and B cannot occur simultaneously, P(A N B) is sometimes called 
"exclusive or,” and P(A U B) = 0. When events A and B can occur simultaneously, 
P(AU B) is sometimes called “inclusive or,” and we use the addition rule to calculate 
P(AU B). Let us illustrate the use of the addition rule by means of an example. 


EXAMPLE 3.4.6 


If we select a person at random from the 318 subjects represented in Table 3.4.1, what is the 
probability that this person will be an Early age of onset subject (Є) or will have no family 
history of mood disorders (A) or both? 


Solution: The probability we seek is P(EU A). By the addition rule as expressed 
by Equation 3.4.3, this probability may be written as P(EUA)= 
P(E) + P(A) — P(EN A). We have already found that P(E) = 141/318 = 
.4434 and P(EN A) = 28/318 = .0881. From the information in Table 3.4.1 
we calculate P(A) — 63/318 — .1981. Substituting these results into the 
equation for P(EUA) we have P(EUA) = 4434 + .1981 — .0881 = 
.5534. ш 


Note that the 28 subjects who are both Early and have no family history of mood disorders 
are included in the 141 who are Early as well as in the 63 who have no family history of 
mood disorders. Since, in computing the probability, these 28 have been added into the 
numerator twice, they have to be subtracted out once to overcome the effect of duplication, 
or overlapping. 


Independent Events Suppose that, in Equation 3.4.2, we are told that event B has 
occurred, but that this fact has no effect on the probability of A. That is, suppose that the 
probability of event A is the same regardless of whether or not B occurs. In this situation, 
Р(А | В) = P(A). In such cases we say that A and B are independent events. The 
multiplication rule for two independent events, then, may be written as 


Р(АП В) = Р(А)Р(В); | Р(А\#0, Р(В) 20 (3.4.4) 


Thus, we see that if two events are independent, the probability of their joint 
occurrence is equal to the product of the probabilities of their individual occurrences. 

Note that when two events with nonzero probabilities are independent, each of the 
following statements is true: 


P(A | B) = P(A), P(B|A) = P(B), P(A п B) = P(A)P(B) 


Two events are not independent unless all these statements are true. It is important to be 
aware that the terms independent and mutually exclusive do not mean the same thing. 
Let us illustrate the concept of independence by means of the following example. 
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EXAMPLE 3.4.7 


In a certain high school class, consisting of 60 girls and 40 boys, it is observed that 24 girls 
and 16 boys wear eyeglasses. If a student is picked at random from this class, the 
probability that the student wears eyeglasses, P(E), is 40/100, or .4. 


(a) What is the probability that a student picked at random wears eyeglasses, given that 
the student is a boy? 


Solution: Ву using the formula for computing a conditional probability, we find this 
to be 


Р(ЕПВ) 16/100 _ 
Р(В) 40/100 ` 


P(E|B) = 


Thus the additional information that а student is a boy does not alter the 
probability that the student wears eyeglasses, and P(E) — P(E | B). We say 
that the events being a boy and wearing eyeglasses for this group are 
independent. We may also show that the event of wearing eyeglasses, Е, 
and not being a boy, B are also independent as follows: 


> P(ENB) 24/100 24 | 
ВВ P(B) 60/100 60 


(b) What is the probability of the joint occurrence of the events of wearing eyeglasses 
and being a boy? 


Solution: Using the rule given in Equation 3.4.1, we have 
Р(ЕП В) = Р(В)Р(Е |В) 


but, since we have shown that events E and B are independent we may replace 
P(E|B) by P(E) to obtain, by Equation 3.4.4, 


P(ENB) = P(B)P(E) 


= (о) (о) 


= 16 н 


Complementary Events Earlier, using the data in Table 3.4.1, we computed the 
probability that a person picked at random from the 318 subjects will be an Early age of 
onset subject as P(E) — 141/318 — .4434. We found the probability of a Later age at onset 
to be P(L) = 177/318 = .5566. The sum of these two probabilities we found to be equal 
to 1. This is true because the events being Early age at onset and being Later age at onset are 
complementary events. In general, we may make the following statement about comple- 
mentary events. The probability of an event A is equal to 1 minus the probability of its 
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complement, which is written A and 
P(A) =1- Р(А) (3.4.5) 


This follows from the third property of probability since the event, A, and its 
complement, Á are mutually exclusive. 


EXAMPLE 3.4.8 


Suppose that of 1200 admissions to a general hospital during a certain period of time, 750 
are private admissions. If we designate these as set A, then A is equal to 1200 minus 750, or 
450. We may compute 


P(A) = 750/1200 — .625 


and 
P(A) = 450/1200 = .375 
and see that 
P(A) = 1 — P(A) 
375 = 1—.625 


.375 2.375 
и 


Marginal Probability Earlier we used the term marginal probability to refer 
to a probability in which the numerator of the probability is a marginal total from a table 
such as Table 3.4.1. For example, when we compute the probability that a person picked 
at random from the 318 persons represented in Table 3.4.1 is an Early age of onset 
subject, the numerator of the probability is the total number of Early subjects, 141. Thus, 
P(E) = 141/318 = .4434. We may define marginal probability more generally as follows: 


DEFINITION 

Given some variable that can be broken down into m categories 
designated by А, А2,..., 4;,..., Am and another jointly occurring 
variable that is broken down into п categories designated by B, 
B»,...,Bj,..., Bn, the marginal probability of 4;, P(A;), is equal to the 
sum of the joint probabilities of 4; with all the categories of B. That is, 


P(A;) = ХР(А; П Bj), for all values of j (3.4.6) 


The following example illustrates the use of Equation 3.4.6 in the calculation of a marginal 
probability. 


EXAMPLE 3.4.9 


We wish to use Equation 3.4.6 and the data in Table 3.4.1 to compute the marginal 
probability P(E). 
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Solution: The variable age at onset is broken down into two categories, Early for onset 
18 years or younger (E) and Later for onset occurring at an age over 18 years 
(L). The variable family history of mood disorders is broken down into four 
categories: negative family history (A), bipolar disorder only (В), unipolar 
disorder only (C), and subjects with a history of both unipolar and bipolar 
disorder (D). The category Early occurs jointly with all four categories of the 
variable family history of mood disorders. The four joint probabilities that 
may be computed are 


P(ENA) = 28/318 = .0881 
P(E N В) = 19/318 = .0597 
Р(ЕП С) = 41/318 = .1289 
P(E N D) = 53/318 = .1667 
We obtain the marginal probability P(E) by adding these four joint probabili- 


ties as follows: 


P(E) = Р(ЕП A) + Р(ЕП B) + Р(ЕП C) + P(En D) 
= .0881 + .0597 + .1289 + .1667 


— 4434 н 


The result, as expected, is the same as the one obtained by using the marginal total for 
Early as the numerator and the total number of subjects as the denominator. 


EXERCISES 


3.4.1 Ina study of violent victimization of women and men, Porcerelli et al. (A-2) collected information 
from 679 women and 345 men aged 18 to 64 years at several family practice centers in the 
metropolitan Detroit area. Patients filled out a health history questionnaire that included a question 
about victimization. The following table shows the sample subjects cross-classified by sex and the 
type of violent victimization reported. The victimization categories are defined as no victimization, 
partner victimization (and not by others), victimization by persons other than partners (friends, 
family members, or strangers), and those who reported multiple victimization. 


No Victimization | Partners | Nonpartners | Multiple Victimization Total 


Women 611 34 16 18 679 
Men 308 10 17 10 345 
Total 919 44 33 28 1024 


Source: Data provided courtesy of John H. Porcerelli, Ph.D., Rosemary Cogan, Ph.D. 


(a) Suppose we pick a subject at random from this group. What is the probability that this subject 
will be a woman? 


(b) What do we call the probability calculated in part a? 
(c) Show how to calculate the probability asked for in part a by two additional methods. 


3.4.2 


3.4.3 
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(d) If we pick a subject at random, what is the probability that the subject will be a woman and have 
experienced partner abuse? 


(e) What do we call the probability calculated in part d? 


(f) Suppose we picked a man at random. Knowing this information, what is the probability that he 
experienced abuse from nonpartners? 


(g) What do we call the probability calculated in part f? 


(h) Suppose we pick a subject at random. What is the probability that it is a man or someone who 
experienced abuse from a partner? 


(i) What do we call the method by which you obtained the probability in part h? 


Fernando et al. (A-3) studied drug-sharing among injection drug users in the South Bronx in New 
York City. Drug users in New York City use the term “split a bag" or “get down on a bag” to refer to 
the practice of dividing a bag of heroin or other injectable substances. A common practice includes 
splitting drugs after they are dissolved in a common cooker, a procedure with considerable HIV risk. 
Although this practice is common, little is known about the prevalence of such practices. The 
researchers asked injection drug users in four neighborhoods in the South Bronx if they ever 
*got down on" drugs in bags or shots. The results classified by gender and splitting practice are 
given below: 


Gender Split Drugs Never Split Drugs Total 


Male 349 324 673 
Female 220 128 348 
Total 569 452 1021 


Source: Daniel Fernando, Robert F. Schilling, Jorge Fontdevila, 
and Nabila El-Bassel, “Predictors of Sharing Drugs among 
Injection Drug Users in the South Bronx: Implications for HIV 
Transmission," Journal of Psychoactive Drugs, 35 (2003), 227—236. 


(a) How many marginal probabilities can be calculated from these data? State each in probability 
notation and do the calculations. 


(b) How many joint probabilities can be calculated? State each in probability notation and do the 
calculations. 


(c) How many conditional probabilities can be calculated? State each in probability notation and do 
the calculations. 


(d) Use the multiplication rule to find the probability that a person picked at random never split 
drugs and is female. 


(e) What do we call the probability calculated in part d? 


(f) Use the multiplication rule to find the probability that a person picked at random is male, given 
that he admits to splitting drugs. 


(g) What do we call the probability calculated in part f? 


Refer to the data in Exercise 3.4.2. State the following probabilities in words and calculate: 
(a) P(Male N Split Drugs) 

(b) P(Male U Split Drugs) 

(c) P(Male | Split Drugs) 

(d) P(Male) 
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3.4.4 


3.4.5 


3.4.6 


3.4.7 


Laveist and Nuru-Jeter (A-4) conducted a study to determine if doctor-patient race concordance was 
associated with greater satisfaction with care. Toward that end, they collected a national sample of 
African-American, Caucasian, Hispanic, and Asian-American respondents. The following table 
classifies the race of the subjects as well as the race of their physician: 


Patient's Race 


African- Asian- 
Physician's Race Caucasian American Hispanic American Total 
White 779 436 406 175 1796 
African-American 14 162 15 Э 196 
Ніѕрапіс 19 17 128 2 166 
Asian/Pacific-Islander 68 75 7l 203 417 
Other 30 55 56 4 145 
Total 910 745 676 389 2720 


Source: Thomas A. Laveist and Amani Nuru-Jeter, “Is Doctor—Patient Race Concordance Associated with Greater 
Satisfaction with Care?" Journal of Health and Social Behavior, 43 (2002), 296—306. 


(a) What is the probability that a randomly selected subject will have an Asian/Pacific-Islander 
physician? 

(b) What is the probability that an African-American subject will have an African-American 
physician? 

(c) Whatis the probability that a randomly selected subject in the study will be Asian-American and 
have an Asian/Pacific-Islander physician? 

(d) What is the probability that a subject chosen at random will be Hispanic or have a Hispanic 
physician? 

(e) Use the concept of complementary events to find the probability that a subject chosen at random 
in the study does not have a white physician. 


If the probability of left-handedness in a certain group of people is .05, what is the probability of 
right-handedness (assuming no ambidexterity)? 


The probability is .6 that a patient selected at random from the current residents of a certain hospital 
will be a male. The probability that the patient will be a male who is in for surgery is .2. A patient 
randomly selected from current residents is found to be a male; what is the probability that the patient 
is in the hospital for surgery? 


In a certain population of hospital patients the probability is .35 that a randomly selected patient will 
have heart disease. The probability is .86 that a patient with heart disease is a smoker. What is the prob- 
ability that a patient randomly selected from the population will be a smoker and have heart disease? 


3.5 BAYES' THEOREM, SCREENING TESTS, 
SENSITIVITY, SPECIFICITY, AND PREDICTIVE 
VALUE POSITIVE AND NEGATIVE 


In the health sciences field a widely used application of probability laws and concepts is 
found in the evaluation of screening tests and diagnostic criteria. Of interest to clinicians is 
an enhanced ability to correctly predict the presence or absence of a particular disease from 
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knowledge of test results (positive or negative) and/or the status of presenting symptoms 
(present or absent). Also of interest is information regarding the likelihood of positive and 
negative test results and the likelihood of the presence or absence of a particular symptom 
in patients with and without a particular disease. 

In our consideration of screening tests, we must be aware of the fact that they are not 
always infallible. That is, a testing procedure may yield a false positive or a false negative. 


DEFINITION гг 

1. A false positive results when a test indicates a positive status when 
the true status is negative. 

2. A false negative results when a test indicates a negative status when 
the true status is positive. 


In summary, the following questions must be answered in order to evaluate the 
usefulness of test results and symptom status in determining whether or not a subject has 
some disease: 


1. Given that a subject has the disease, what is the probability of a positive test result (or 
the presence of a symptom)? 


2. Given that a subject does not have the disease, what is the probability of a negative 
test result (or the absence of a symptom)? 


3. Given a positive screening test (or the presence of a symptom), what is the probability 
that the subject has the disease? 


4. Given a negative screening test result (or the absence of a symptom), what is the 
probability that the subject does not have the disease? 


Suppose we have for a sample of n subjects (where n is a large number) the 
information shown in Table 3.5.1. The table shows for these n subjects their status with 
regard to a disease and results from a screening test designed to identify subjects with the 
disease. The cell entries represent the number of subjects falling into the categories defined 
by the row and column headings. For example, a is the number of subjects who have the 
disease and whose screening test result was positive. 

As we have learned, a variety of probability estimates may be computed from the 
information displayed in a two-way table such as Table 3.5.1. For example, we may 


TABLE 3.5.1 Sample of n Subjects (Where n Is 
Large) Cross-Classified According to Disease Status 
and Screening Test Result 


Disease 
Test Result Present (D) Absent (D) Total 
Positive (T) a b a+b 
Negative (T) с а с+а 


Total a+c b+ d n 
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compute the conditional probability estimate P(T |D) = а/(а + с). This ratio is an 
estimate of the sensitivity of the screening test. 


DEFINITION 
The sensitivity of a test (or symptom) is the probability of a positive test 
result (or presence of the symptom) given the presence of the disease. 


We may also compute the conditional probability estimate P(T | D) — d/(b 4- d). 
This ratio is an estimate of the specificity of the screening test. 


DEFINITION — 
The specificity of a test (or symptom) is the probability of a negative test 
result (or absence of the symptom) given the absence of the disease. 


From the data in Table 3.5.1 we answer Question 3 by computing the conditional 
probability estimate P(D | T). This ratio is an estimate of a probability called the predictive 
value positive of a screening test (or symptom). 


DEFINITION 

The predictive value positive of a screening test (or symptom) is the 
probability that a subject has the disease given that the subject has a 
positive screening test result (or has the symptom). 


Similarly, the ratio P(D | T) is an estimate of the conditional probability that a subject 
does not have the disease given that the subject has a negative screening test result (or does 
not have the symptom). The probability estimated by this ratio is called the predictive value 
negative of the screening test or symptom. 


DEFINITION 

The predictive value negative of a screening test (or symptom) is the 
probability that a subject does not have the disease, given that the subject 
has a negative screening test result (or does not have the symptom). 


Estimates of the predictive value positive and predictive value negative of a test (or 
symptom) may be obtained from knowledge of a test's (or symptom's) sensitivity and 
specificity and the probability of the relevant disease in the general population. To obtain 
these predictive value estimates, we make use of Bayes's theorem. The following statement 
of Bayes's theorem, employing the notation established in Table 3.5.1, gives the predictive 
value positive of a screening test (or symptom): 


P(T |D)P(D) 


РТ) = вті руР(р) + PCT | БУРИ) Bal) 
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It is instructive to examine the composition of Equation 3.5.1. We recall from 
Equation 3.4.2 that the conditional probability P(D| T) is equal to P(D A T)/P(T). To 
understand the logic of Bayes's theorem, we must recognize that the numerator of Equation 
3.5.1 represents P(D N T) and that the denominator represents P(T). We know from the 
multiplication rule of probability given in Equation 3.4.1 that the numerator of Equation 
3.5.1, P(T | D) P(D), is equal to P(DN T). 

Now let us show that the denominator of Equation 3.5.1 is equal to P(T). We know 
that event T is the result of a subject's being classified as positive with respect to a 
screening test (or classified as having the symptom). A subject classified as positive may 
have the disease or may not have the disease. Therefore, the occurrence of Т is the result 
of a subject having the disease and being positive [P(D  T)] or not having the disease 
and being positive [P(D n T)]. These two events are mutually exclusive (their intersec- 
tion is zero), and consequently, by the addition rule given by Equation 3.4.3, we 
may write 


Р(Т) = P(DnT)  P(DnT) (3.5.2) 


Since, by the multiplication гше, P(DnT) = P(T|D) P(D) апа P(Dn T) = 
P(T | D) P(D), we may rewrite Equation 3.5.2 as 


P(T) = P(T | D)P(D) + P(T | D)P(D) (3.5.3) 


which is the denominator of Equation 3.5.1. 

Note, also, that the numerator of Equation 3.5.1 is equal to the sensitivity times the 
rate (prevalence) of the disease and the denominator is equal to the sensitivity times the rate 
of the disease plus the term / minus the sensitivity times the term / minus the rate of the 
disease. Thus, we see that the predictive value positive can be calculated from knowledge 
of the sensitivity, specificity, and the rate of the disease. 

Evaluation of Equation 3.5.1 answers Question 3. To answer Question 4 we 
follow a now familiar line of reasoning to arrive at the following statement of Bayes's 
theorem: 


P(D|T) — (3.5.4) 


Equation 3.5.4 allows us to compute an estimate of the probability that a subject who is 
negative on the test (or has no symptom) does not have the disease, which is the predictive 
value negative of a screening test or symptom. 

We illustrate the use of Bayes' theorem for calculating a predictive value positive 
with the following example. 


EXAMPLE 3.5.1 


A medical research team wished to evaluate a proposed screening test for Alzheimer's 
disease. The test was given to a random sample of 450 patients with Alzheimer's disease 
and an independent random sample of 500 patients without symptoms of the disease. 
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The two samples were drawn from populations of subjects who were 65 years of age or 
older. The results are as follows: 


Alzheimer's Diagnosis? 


Test Result Yes (D) No (D) Total 
Positive (T) 436 5 441 
Negative (T) 14 495 509 
Total 450 500 950 


Using these data we estimate the sensitivity of the test to be P(T | D) = 436/450 = .97. The 
specificity of the test is estimated to be P(T | D) — 495/500 — .99. We now use the results of 
the study to compute the predictive value positive of the test. That is, we wish to estimate the 
probability that a subject who is positive on the test has Alzheimer's disease. From the 
tabulated data we compute P(T | D) = 436/450 = .9689 and P(T | D) = 5/500 = .01. 
Substitution of these results into Equation 3.5.1 gives 


(.9689)P(D) 
(.9689)P(D) + (.01)P(D) 


P(D|T) = (3.5.5) 


We see that the predictive value positive of the test depends on the rate of the disease in the 
relevant population in general. In this case the relevant population consists of subjects who 
are 65 years of age or older. We emphasize that the rate of disease in the relevant general 
population, P(D), cannot be computed from the sample data, since two independent samples 
were drawn from two different populations. We must look elsewhere for an estimate of P(D). 
Evans et al. (A-5) estimated that 11.3 percent of the U.S. population aged 65 and over have 
Alzheimer's disease. When we substitute this estimate of P(D) into Equation 3.5.5 we 
obtain 


(.9689)(.113) 
(.9689) (.113) + (.01)(1 — .113) 


P(D|T) = =.93 


As we see, in this case, the predictive value of the test is very high. 

Similarly, let us now consider the predictive value negative of the test. We have 
already calculated all entries necessary except for P(T | D) = 14/450 = .0311. Using the 
values previously obtained and our new value, we find 


(.99)(1 — .113) 


POD = соду 113) + (311) 13) 


= .996 


As we see, the predictive value negative is also quite high. B 
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EXERCISES 


3.5.1 


3.5.2 


3.5.3 


A medical research team wishes to assess the usefulness of a certain symptom (call it 5) in the 
diagnosis of a particular disease. In a random sample of 775 patients with the disease, 744 reported 
having the symptom. In an independent random sample of 1380 subjects without the disease, 21 
reported that they had the symptom. 


(a) In the context of this exercise, what is a false positive? 
(b) What is a false negative? 

(c) Compute the sensitivity of the symptom. 

(d) Compute the specificity of the symptom. 


(e) Suppose it is known that the rate of the disease in the general population is. 001. What is the 
predictive value positive of the symptom? 


(f) What is the predictive value negative of the symptom? 


(g) Find the predictive value positive and the predictive value negative for the symptom for the 
following hypothetical disease rates: .0001, .01, and .10. 


(h) What do you conclude about the predictive value of the symptom on the basis of the results 
obtained in part g? 


In an article entitled “Bucket-Handle Meniscal Tears of the Knee: Sensitivity and Specificity of MRI 
signs," Dorsay and Helms (A-6) performed a retrospective study of 71 knees scanned by MRI. One of 
the indicators they examined was the absence of the “bow-tie sign” in the MRI as evidence of a 
bucket-handle or “bucket-handle type” tear of the meniscus. In the study, surgery confirmed that 43 of 
the 71 cases were bucket-handle tears. The cases may be cross-classified by “bow-tie sign” status and 
surgical results as follows: 


Tear Surgically Tear Surgically Confirmed As 

Confirmed (D) Not Present (D) Total 
Positive Test 38 10 48 
(absent bow-tie sign) (T) 
Negative Test 5 18 23 
(bow-tie sign present) (Т) 
Total 43 28 71 


Source: Theodore A. Dorsay and Clyde A. Helms, “Bucket-handle Meniscal Tears of the Knee: Sensitivity 
and Specificity of MRI Signs," Skeletal Radiology, 32 (2003), 266—272. 


(a) What is the sensitivity of testing to see if the absent bow tie sign indicates a meniscal tear? 
(b) What is the specificity of testing to see if the absent bow tie sign indicates a meniscal tear? 


(c) What additional information would you need to determine the predictive value of the test? 


Oexle et al. (A-7) calculated the negative predictive value of a test for carriers of X-linked ornithine 
transcarbamylase deficiency (OTCD—a disorder of the urea cycle). A test known as the “allopurinol 
test" is often used as a screening device of potential carriers whose relatives are OTCD patients. They 
cited a study by Brusilow and Horwich (A-8) that estimated the sensitivity of the allopurinol test as 
.927. Oexle et al. themselves estimated the specificity of the allopurinol test as .997. Also they 
estimated the prevalence in the population of individuals with OTCD as 1/32000. Use this 
information and Bayes's theorem to calculate the predictive value negative of the allopurinol 
screening test. 
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3.6 SUMMARY 


In this chapter some of the basic ideas and concepts of probability were presented. The 
objective has been to provide enough of a “feel” for the subject so that the probabilistic 
aspects of statistical inference can be more readily understood and appreciated when this 
topic is presented later. 

We defined probability as a number between 0 and 1 that measures the likelihood of 
the occurrence of some event. We distinguished between subjective probability and 
objective probability. Objective probability can be categorized further as classical or 
relative frequency probability. After stating the three properties of probability, we defined 
and illustrated the calculation of the following kinds of probabilities: marginal, joint, and 
conditional. We also learned how to apply the addition and multiplication rules to find 
certain probabilities. We learned the meaning of independent, mutually exclusive, and 
complementary events. We learned the meaning of specificity, sensitivity, predictive value 
positive, and predictive value negative as applied to a screening test or disease symptom. 
Finally, we learned how to use Bayes's theorem to calculate the probability that a subject 
has a disease, given that the subject has a positive screening test result (or has the symptom 
of interest). 


SUMMARY OF FORMULAS FOR CHAPTER 3 


Formula number | Name Formula 
324 Classical probability Р(Е) = т 
N 
3.2.2 Relative frequency P(E) = uc 
probability n 
3.3.1-3.3.3 Properties of probability P(E;) 2 0 
P(E) + P(E2) 4 + P(E,) = 1 
P(E; + Ej) = Р(Е;) + Р(Е)) 
3.4.1 Multiplication rule P(ANB) = P(B)P(A|B) = P(A)P(B|A) 
3.4.2 Conditional probability P(A|B) = P(ANB) 
P(B) 
3.4.3 Addition rule P(A UB) = P(A) + P(B) - P(A п B) 
3.4.4 Independent events P(A П B) = P(A)P(B) 
3.4.5 Complementary events P(A) = 1 — P(A) 
3.4.6 Marginal probability Р(А;) = У P(A; ПВ) 
Sensitivity of a screening test | рет |р) = 
Specificity of a screening test P(T|D) = d 
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3.5.1 Predictive value positive of a P(D|T) = P(T|D)P(D) 
screening test P(T | D)P(D) + P(T | D)P(D) 
3.52 Predictive value negative of a P(D|T) = P(T | D)P(D) 
screening test P(T | D)P(D) + P(T | D)P(D) 
Symbol Key * D — disease 


* E — Event 


equally likely events 


occurring 


* m= the number of times an event E; occurs 
* n — sample size or the total number of times a process occurs 
* N — Population size or the total number of mutually exclusive and 


* P(A) = a complementary event; the probability of an event A, not 


* P(E;) = probability of some event E; occurring 


P(A B) = an "intersection" or “and” statement; the probability of 
an event A and an event B occurring 

P(AU B) — an “union” or “or” statement; the probability of an event 
A or an event B or both occurring 


* T — test results 


REVIEW QUESTIONS AND EXERCISES 


* P(A|B) — a conditional statement; the probability of an event A 
occurring given that an event B has already occurred 


1. Define the following: 


(a) Probability 
(c) Subjective probability 
(e) The relative frequency concept of probability 
(g) Independence 
(i) Joint probability 
(k) The addition rule 
(m) Complementary events 
(о) False negative 
(q) Specificity 
(s) Predictive value negative 


2. Name and explain the three properties of probability. 


(b) Objective probability 

(d) Classical probability 

(f) Mutually exclusive events 
(h) Marginal probability 

(j) Conditional probability 
(1) The multiplication rule 
(n) False positive 

(p) Sensitivity 

(r) Predictive value positive 
(t) Bayes's theorem 


3. Coughlin et al. (A-9) examined the breast and cervical screening practices of Hispanic and non- 
Hispanic women in counties that approximate the U.S. southern border region. The study used data 
from the Behavioral Risk Factor Surveillance System surveys of adults age 18 years or older 
conducted in 1999 and 2000. The table below reports the number of observations of Hispanic and 
non-Hispanic women who had received a mammogram in the past 2 years cross-classified with 


marital status. 
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Marital Status Hispanic Non-Hispanic Total 
Currently Married 319 738 1057 
Divorced or Separated 130 329 459 
Widowed 88 402 490 
Never Married or Living As 41 95 136 


an Unmarried Couple 


Total 578 1564 2142 


Source: Steven S. Coughlin, Robert J. Uhler, Thomas Richards, and Katherine 
M. Wilson, “Breast and Cervical Cancer Screening Practices Among Hispanic 
and Non-Hispanic Women Residing Near the United States-Mexico Border, 
1999-2000,” Family and Community Health, 26 (2003), 130-139. 


(a) We select at random a subject who had a mammogram. What is the probability that she is 
divorced or separated? 


(b) We select at random a subject who had a mammogram and learn that she is Hispanic. With that 
information, what is the probability that she is married? 

(c) We select at random a subject who had a mammogram. What is the probability that she is non- 
Hispanic and divorced or separated? 

(d) We select at random a subject who had a mammogram. What is the probability that she is 
Hispanic or she is widowed? 


(e) We select at random a subject who had a mammogram. What is the probability that she is not 
married? 


4. Swor et al. (A-10) looked at the effectiveness of cardiopulmonary resuscitation (CPR) training in 
people over 55 years old. They compared the skill retention rates of subjects in this age group who 
completed a course in traditional CPR instruction with those who received chest-compression only 
cardiopulmonary resuscitation (CC-CPR). Independent groups were tested 3 months after training. 
The table below shows the skill retention numbers in regard to overall competence as assessed by 
video ratings done by two video evaluators. 


Rated Overall 

Competent CPR CC-CPR Total 
Yes 12 15 27 
No 15 14 29 
Total 27 29 56 


Source: Robert Swor, Scott Compton, Fern Vining, Lynn Ososky 

Farr, Sue Kokko, Rebecca Pascual, and Raymond E. Jackson, 

“A Randomized Controlled Trial of Chest Compression Only 

CPR for Older Adults—a Pilot Study,” Resuscitation, 58 (2003), 
177-185. 

(a) Find the following probabilities and explain their meaning: 


1. A randomly selected subject was enrolled in the CC-CPR class. 

. A randomly selected subject was rated competent. 

. A randomly selected subject was rated competent and was enrolled in the CPR course. 

. A randomly selected subject was rated competent or was enrolled in CC-CPR. 

. A Randomly selected subject was rated competent given that they enrolled in the CC-CPR 
course. 


Un RU ә 
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(b) We define the following events to be 
A — a subject enrolled in the CPR course 
B — a subject enrolled in the CC-CPR course 
C — a subject was evaluated as competent 
D = a subject was evaluated as not competent 


Then explain why each of the following equations is or is not a true statement: 


1.P(An С) =Р(СПА) 2. P(A U B) = P(B UA) 

3. P(A) = P(A U C) + P(A U D) 4. P(B U C) = P(B) + P(C) 
5. P(D|A) = P(D) 6. P(C B) = P(C)P(B) 

7. Р(АП B) 20 8. P(Cn В) = Р(В)Р(С |В) 


9. P(AND) = Р(А)Р(А|р) 

5. Pillman et al. (A-11) studied patients with acute brief episodes of psychoses. The researchers 
classified subjects into four personality types: obsessiod, asthenic/low self-confident, asthenic/high 
self-confident, nervous/tense, and undeterminable. The table below cross-classifies these personality 
types with three groups of subjects—those with acute and transient psychotic disorders (ATPD), 
those with "positive" schizophrenia (PS), and those with bipolar schizo-affective disorder (BSAD): 


Personality Type ATPD (1)  Р5(2) BSAD(3) Total 
Obsessoid (O) 9 2 6 17 
Asthenic/low Self-confident (A) 20 17 15 52 
Asthenic /high Self-confident (S) 5 3 8 16 
Nervous/tense (N) 4 7 4 15 
Undeterminable (U) 4 13 9 26 


Total 42 42 42 126 


Source: Frank Pillmann, Raffaela Bloink, Sabine Balzuweit, Annette Haring, and 
Andreas Marneros, “Personality and Social Interactions in Patients with Acute Brief 
Psychoses," Journal of Nervous and Mental Disease, 191 (2003), 503—508. 


Find the following probabilities if a subject in this study is chosen at random: 
(a) P(O) (b) P(AU2) (© РИ) (d) P(A) 
(e) P(A|3) (f P(3) (в) P(2n3) (h) P(2|A) 


6. Acertain county health department has received 25 applications for an opening that exists for a public 
health nurse. Of these applicants 10 are over 30 and 15 are under 30. Seventeen hold bachelor's 
degrees only, and eight have master's degrees. Of those under 30, six have master's degrees. If a 
selection from among these 25 applicants is made at random, what is the probability that a person 
over 30 or a person with a master's degree will be selected? 


7. The following table shows 1000 nursing school applicants classified according to scores made on a 
college entrance examination and the quality of the high school from which they graduated, as rated 
by a group of educators: 


Quality of High Schools 
Score Poor(P)  Average(A)  Superior(S) Total 
Low (L) 105 60 55 220 
Medium (M) 70 175 145 390 
High (Н) 25 65 300 390 


Total 200 300 500 1000 
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10. 


11. 


(a) Calculate the probability that an applicant picked at random from this group: 


1. Made a low score on the examination. 

2. Graduated from a superior high school. 

3. Made a low score on the examination and graduated from a superior high school. 

4. Made a low score on the examination given that he or she graduated from a superior high 
School. 

5. Made a high score or graduated from a superior high school. 


(b) Calculate the following probabilities: 


1. Р(А) 2. P(H) 3. P(M) 
4.Р(А|Н) | 5.Р(МПР) | 6.(Н|5) 


If the probability that a public health nurse will find a client at home is .7, what is the probability 
(assuming independence) that on two home visits made in a day both clients will be home? 


For a variety of reasons, self-reported disease outcomes are frequently used without verification in 
epidemiologic research. In a study by Parikh-Patel et al. (A-12), researchers looked at the relationship 
between self-reported cancer cases and actual cases. They used the self-reported cancer data from a 
California Teachers Study and validated the cancer cases by using the California Cancer Registry 
data. The following table reports their findings for breast cancer: 


Cancer Reported (A) Cancer in Registry (B) Cancer Not in Registry Total 

Yes 2991 2244 5235 
No 112 115849 115961 
Total 3103 118093 121196 


Source: Arti Parikh-Patel, Mark Allen, William E. Wright, and the California Teachers Study Steering Committee, 
“Validation of Self-reported Cancers in the California Teachers Study,” American Journal of Epidemiology, 
157 (2003), 539-545. 


(a) Let A be the event of reporting breast cancer in the California Teachers Study. Find the 
probability of A in this study. 

(b) Let B be the event of having breast cancer confirmed in the California Cancer Registry. Find the 
probability of B in this study. 

(c) Find P(AN В) 

(d) Find (A| B) 

(e) Find Р(В|А) 

(f) Find the sensitivity of using self-reported breast cancer as a predictor of actual breast cancer in 
the California registry. 

(g) Find the specificity of using self-reported breast cancer as a predictor of actual breast cancer in 
the California registry. 


In a certain population the probability that a randomly selected subject will have been exposed to 
a certain allergen and experience a reaction to the allergen is .60. The probability is .8 that a 
subject exposed to the allergen will experience an allergic reaction. If a subject is selected at 
random from this population, what is the probability that he or she will have been exposed to the 
allergen? 


Suppose that 3 percent of the people in a population of adults have attempted suicide. It is also known 
that 20 percent of the population are living below the poverty level. If these two events are 


12. 


13. 


14. 


15. 
16. 
17. 
18. 


19. 


20. 


21. 
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independent, what is the probability that a person selected at random from the population will have 
attempted suicide and be living below the poverty level? 


In a certain population of women 4 percent have had breast cancer, 20 percent are smokers, and 3 
percent are smokers and have had breast cancer. A woman is selected at random from the population. 
What is the probability that she has had breast cancer or smokes or both? 


The probability that a person selected at random from a population will exhibit the classic symptom 
of a certain disease is .2, and the probability that a person selected at random has the disease is .23. 
The probability that a person who has the symptom also has the disease is .18. A person selected at 
random from the population does not have the symptom. What is the probability that the person has 
the disease? 


For a certain population we define the following events for mother's age at time of giving birth: A — 
under 20 years; B — 20—24 years; C — 25-29 years; D — 30-44 years. Are the events A, B, C, and D 
pairwise mutually exclusive? 


Refer to Exercise 14. State in words the event E — (AU B). 
Refer to Exercise 14. State in words the event F — (BU C). 
Refer to Exercise 14. Comment on the event С = (АПВ). 


For a certain population we define the following events with respect to plasma lipoprotein levels 
(mg/dl): A = (10-15); B = (> 30); € = (< 20). Are the events A and B mutually exclusive? A and 
C? B and C? Explain your answer to each question. 


Refer to Exercise 18. State in words the meaning of the following events: 


(a) AUB (b АПВ (АПС (dAUC 


Refer to Exercise 18. State in words the meaning of the following events: 


(a) А (b) B (с) C 


Rothenberg et al. (A-13) investigated the effectiveness of using the Hologic Sahara Sonometer, a 
portable device that measures bone mineral density (BMD) in the ankle, in predicting a fracture. They 
used a Hologic estimated bone mineral density value of .57 as a cutoff. The results of the 
investigation yielded the following data: 


Confirmed Fracture 


Present (D | Not Present (D) Total 


BMD = .57(T) 214 670 884 
BMD > .57(T) 73 330 403 
Total 287 1000 1287 


Source: Data provided courtesy of Ralph J. Rothenberg, M.D., Joan 
L. Boyd, Ph.D., and John P. Holcomb, Ph.D. 


(a) Calculate the sensitivity of using a BMD value of .57 as a cutoff value for predicting fracture and 
interpret your results. 
(b) Calculate the specificity of using a BMD value of .57 as a cutoff value for predicting fracture and 
interpret your results. 
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22. 


23. 


Verma et al. (A-14) examined the use of heparin-PF4 ELISA screening for heparin-induced 
thrombocytopenia (HIT) in critically ill patients. Using C-serotonin release assay (SRA) as the 
way of validating HIT, the authors found that in 31 patients tested negative by SRA, 22 also tested 
negative by heparin-PF4 ELISA. 

(a) Calculate the specificity of the heparin-PF4 ELISA testing for HIT. 


(b) Using а “literature derived sensitivity” of 95 percent and a prior probability of HIT occurrence as 
3.1 percent, find the positive predictive value. 


(c) Using the same information as part (b), find the negative predictive value. 


The sensitivity of a screening test is .95, and its specificity is .85. The rate of the disease for which the 
test is used is .002. What is the predictive value positive of the test? 


Exercises for Use with Large Data Sets Available on the Following Website: 
www.wiley.com/college/daniel 


Refer to the random sample of 800 subjects from the North Carolina birth registry we investigated in 
the Chapter 2 review exercises. 


1. Create a table that cross-tabulates the counts of mothers in the classifications of whether the baby 
was premature or not (PREMIE) and whether the mother admitted to smoking during pregnancy 
(SMOKE) or not. 


(a) Find the probability that a mother in this sample admitted to smoking. 

(b) Find the probability that a mother in this sample had a premature baby. 

(c) Find the probability that a mother in the sample had a premature baby given that the mother 
admitted to smoking. 

(d) Find the probability that a mother in the sample had a premature baby given that the mother 
did not admit to smoking. 

(e) Find the probability that a mother in the sample had a premature baby or that the mother did 
not admit to smoking. 


2. Create a table that cross-tabulates the counts of each mother's marital status (MARITAL) and 
whether she had a low birth weight baby (LOW). 


(a) Find the probability a mother selected at random in this sample had a low birth weight baby. 

(b) Find the probability a mother selected at random in this sample was married. 

(c) Find the probability a mother selected at random in this sample had a low birth weight child 
given that she was married. 

(d) Find the probability a mother selected at random in this sample had a low birth weight child 
given that she was not married. 

(e) Find the probability a mother selected at random in this sample had a low birth weight child 
and the mother was married. 
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CHAPTER 4 


PROBABILITY DISTRIBUTIONS 


CHAPTER OVERVIEW 


TOPICS 


Probability distributions of random variables assume powerful roles in statis- 
tical analyses. Sincethey show all possible values ofa random variable andthe 
probabilities associated with these values, probability distributions may be 
summarized in ways that enable researchers to easily make objective deci- 
sions based on samples drawn from the populations that the distributions 
represent. This chapter introduces frequently used discrete and continuous 
probability distributions that are used in later chapters to make statistical 
inferences. 
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After studying this chapter, the student will 


1. 


understand selected discrete distributions and how to use them to calculate 
probabilities in real-world problems. 
understand selected continuous distributions and how to use them to calculate 
probabilities in real-world problems. 
be able to explain the similarities and differences between distributions of the 
discrete type and the continuous type and when the use of each is appropriate. 
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4.1 INTRODUCTION 


In the preceding chapter we introduced the basic concepts of probability as well as methods 
for calculating the probability of an event. We build on these concepts in the present chapter 
and explore ways of calculating the probability of an event under somewhat more complex 
conditions. In this chapter we shall see that the relationship between the values of a random 
variable and the probabilities of their occurrence may be summarized by means of a device 
called a probability distribution. A probability distribution may be expressed in the form of 
a table, graph, or formula. Knowledge of the probability distribution of a random variable 
provides the clinician and researcher with a powerful tool for summarizing and describing 
a set of data and for reaching conclusions about a population of data on the basis of a 
sample of data drawn from the population. 


4.2 PROBABILITY DISTRIBUTIONS 
OF DISCRETE VARIABLES 


Let us begin our discussion of probability distributions by considering the probability 
distribution of a discrete variable, which we shall define as follows: 


DEFINITION 


The probability distribution of a discrete random variable is a table, 
graph, formula, or other device used to specify all possible values of a 
discrete random variable along with their respective probabilities. 


If we let the discrete probability distribution be represented by p(x), then p(x) — 
P(X — x) is the probability of the discrete random variable X to assume a value x. 


EXAMPLE 4.2.1 


In an article appearing in the Journal of the American Dietetic Association, Holben et al. 
(A-1) looked at food security status in families in the Appalachian region of southern Ohio. 
The purpose of the study was to examine hunger rates of families with children in a local 
Head Start program in Athens, Ohio. The survey instrument included the 18-question U.S. 
Household Food Security Survey Module for measuring hunger and food security. In 
addition, participants were asked how many food assistance programs they had used in the 
last 12 months. Table 4.2.1 shows the number of food assistance programs used by subjects 
in this sample. 

We wish to construct the probability distribution of the discrete variable X, where 
X — number of food assistance programs used by the study subjects. 


Solution: The values of X are x; = 1,0 = 2,...,x; = 7, and хз = 8. We compute the 
probabilities for these values by dividing their respective frequencies by 
the total, 297. Thus, for example, p(xi) = Р(Х = хі) = 62/297 = .2088. 
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TABLE 4.2.1 Number of Assistance 
Programs Utilized by Families with 
Children in Head Start Programs in 
Southern Ohio 


Number of Programs Frequency 


62 
47 
39 


Го о ч фо ост 5» о N29 
о 
00 


Total 297 


Source: Data provided courtesy of David H. Holben, 
Ph.D. and John P. Holcomb, Ph.D. 


TABLE 4.2.2 Probability Distribution 
of Programs Utilized by Families 
Among the Subjects Described in 
Example 4.2.1 


Number of Programs (x) P(X =x) 


Го о ч соб с Ь CN = 
> 
c 
al 
wo 


Total 1.0000 


We display the results in Table 4.2.2, which is the desired probability 
distribution. и 


Alternatively, we can present this probability distribution in the form of a graph, as in 
Figure 4.2.1. In Figure 4.2.1 the length of each vertical bar indicates the probability for the 
corresponding value of x. 

It will be observed in Table 4.2.2 that the values of p(x) — P(X — x) are all 
positive, they are all less than 1, and their sum is equal to 1. These are not phenomena 
peculiar to this particular example, but are characteristics of all probability distributions 
of discrete variables. If x1,x5,x3,...,xy аге all possible values of the discrete random 
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FIGURE 4.2.1 Graphical representation of the probability 
distribution shown in Table 4.2.1. 


variable X, then we may then give the following two essential properties of a probability 
distribution of a discrete variable: 


(1) O<P(X=x)<1 
(2) УР(Х= х) = 1, forallx 


The reader will also note that each of the probabilities in Table 4.2.2 is the relative 
frequency of occurrence of the corresponding value of X. 

With its probability distribution available to us, we can make probability statements 
regarding the random variable X. We illustrate with some examples. 


EXAMPLE 4.2.2 


What is the probability that a randomly selected family used three assistance programs? 


Solution: We may write the desired probability as p(3) — P(X — 3). We see in 
Table 4.2.2 that the answer is .1313. ш 


EXAMPLE 4.2.3 
What is the probability that a randomly selected family used either one or two programs? 
Solution: To answer this question, we use the addition rule for mutually exclusive 


events. Using probability notation and the results in Table 4.2.2, we write the 
answer as P(1 U2) = Р(1) + P(2) = .2088 + .1582 = 3670. ш 
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TABLE 4.2.3 Cumwulative Probability Distribution of 
Number of Programs Utilized by Families Among the 
Subjects Described in Example 4.2.1 


Number of Programs (x) Cumulative Frequency P(X < x) 


.2088 
.3670 
.4983 
.6296 
.8249 
.9495 
.9630 
1.0000 


0 мотом = 


Cumulative Distributions Sometimes it will be more convenient to work with 
the cumulative probability distribution of a random variable. The cumulative probability 
distribution for the discrete variable whose probability distribution is given in Table 4.2.2 
may be obtained by successively adding the probabilities, P(X — x;), given in the last 
column. The cumulative probability for x; is written as F(x;) = P(X < x;). It gives the 
probability that X is less than or equal to a specified value, x;. 

The resulting cumulative probability distribution is shown in Table 4.2.3. The graph 
of the cumulative probability distribution is shown in Figure 4.2.2. The graph of a 
cumulative probability distribution is called an ogive. In Figure 4.2.2 the graph of F(x) 
consists solely of the horizontal lines. The vertical lines only give the graph a connected 
appearance. The length of each vertical line represents the same probability as that of the 
corresponding line in Figure 4.2.1. For example, the length of the vertical line at X — 3 
in Figure 4.2.2 represents the same probability as the length of the line erected at X — 3 in 
Figure 4.2.1, or .1313 on the vertical scale. 
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FIGURE 4.2.2 Cumulative probability distribution of number of assistance programs 
among the subjects described in Example 4.2.1. 
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By consulting the cumulative probability distribution we may answer quickly 
questions like those in the following examples. 


EXAMPLE 4.2.4 


What is the probability that a family picked at random used two or fewer assistance 
programs? 


Solution: The probability we seek may be found directly in Table 4.2.3 by reading the 
cumulative probability opposite x — 2, and we see that it is .3670. That is, 
Р(Х < 2) = .3670. We also may find the answer by inspecting Figure 4.2.2 
and determining the height of the graph (as measured on the vertical axis) 
above the value X — 2. и 


EXAMPLE 4.2.5 


What is the probability that а randomly selected family used fewer than four programs? 


Solution: Since a family that used fewer than four programs used either one, two, or 
three programs, the answer is the cumulative probability for 3. That is, 
Р(Х < 4) = Р(Х € 3) = 4983. и 


EXAMPLE 4.2.6 


What is the probability that a randomly selected family used five or more programs? 


Solution: То find the answer we make use of the concept of complementary probabili- 
ties. The set of families that used five or more programs is the complement of 
the set of families that used fewer than five (that is, four or fewer) programs. 
The sum of the two probabilities associated with these sets is equal to 1. We 
write this relationship in probability notation as P(X > 5) + P(X < 4) = 1. 
Therefore, P(X > 5) = 1 Р(Х € 4) = 1 - .6296 = .3704. ш 


EXAMPLE 4.2.7 


What is the probability that a randomly selected family used between three and five 
programs, inclusive? 


Solution: P(X < 5) = .8249 is the probability that a family used between one and five 
programs, inclusive. To get the probability of between three and five 
programs, we subtract, from .8249, the probability of two or fewer. Using 
probability notation we write the answer as P(3 < X < 5) = P(X < 5)— 
P(X € 2) = .8249 — .3670 — .4579. [| 


The probability distribution given in Table 4.2.1 was developed out of actual experience, so 
to find another variable following this distribution would be coincidental. The probability 
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distributions of many variables of interest, however, can be determined or assumed on the 
basis of theoretical considerations. In later sections, we study in detail three of these 
theoretical probability distributions: the binomial, the Poisson, and the normal. 


Mean and Variance of Discrete Probability Distributions The 
mean and variance of a discrete probability distribution can easily be found using the 
formulae below. 


и = У `хр(х) (4.2.1) 
а? = У (x - uyp(x) = xp) - и? (4.2.2) 


where p(x) is the relative frequency of a given random variable X. The standard deviation is 
simply the positive square root of the variance. 


EXAMPLE 4.2.8 


What are the mean, variance, and standard deviation of the distribution from Example 4.2.1? 


Solution: 
u = (1)(.2088) + (2)(.1582) + (3)(.1313) +... + (8)(.0370) = 3.5589 
o? = (1 - 3.5589)? (.2088) + (2 — 3.5589)?(.1582) + (3 — 3.5589)?(.1313) 
+... (8 — 3.5589)? (.0370) = 3.8559 


We therefore can conclude that the mean number of programs utilized was 3.5589 with а 
variance of 3.8559. The standard deviation is therefore ү 3.8559 = 1.9637 programs. M 


EXERCISES 


4.2.1. 


4.2.3. 


In a study by Cross et al. (A-2), patients who were involved in problem gambling treatment were 
asked about co-occurring drug and alcohol addictions. Let the discrete random variable X represent 
the number of co-occurring addictive substances used by the subjects. Table 4.2.4 summarizes the 
frequency distribution for this random variable. 


(a) Construct a table of the relative frequency and the cumulative frequency for this discrete 
distribution. 


(b) Construct a graph of the probability distribution and a graph representing the cumulative 
probability distribution for these data. 

Refer to Exercise 4.2.1. 

(a) What is probability that an individual selected at random used five addictive substances? 


(b) What is the probability that an individual selected at random used fewer than three addictive 
substances? 


(c) What is the probability that an individual selected at random used more than six addictive 
substances? 


(d) What is the probability that an individual selected at random used between two and five addictive 
substances, inclusive? 


Refer to Exercise 4.2.1. Find the mean, variance, and standard deviation of this frequency distribution. 
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TABLE 4.2.4 Number of Co-occurring Addictive Substances 
Used by Patients in Selected Gambling Treatment Programs 


Number of Substances Used Frequency 
0 144 
1 342 
2 142 
3 72 
4 39 
5 20 
6 6 
7 9 
8 2 
9 1 
Total 777 


4.3 THEBINOMIAL DISTRIBUTION 


The binomial distribution is one of the most widely encountered probability distributions in 
applied statistics. The distribution is derived from a process known as a Bernoulli trial, 
named in honor of the Swiss mathematician James Bernoulli (1654-1705), who made 
significant contributions in the field of probability, including, in particular, the binomial 
distribution. When a random process or experiment, called a trial, can result in only one of 
two mutually exclusive outcomes, such as dead or alive, sick or well, full-term or 
premature, the trial is called a Bernoulli trial. 


The Bernoulli Process A sequence of Bernoulli trials forms a Bernoulli process 
under the following conditions. 


1. Each trial results in one of two possible, mutually exclusive, outcomes. One of the 
possible outcomes 15 denoted (arbitrarily) as a success, and the other is denoted a failure. 


2. The probability of a success, denoted by p, remains constant from trial to trial. The 
probability of a failure, 1 — p, is denoted by q. 


3. The trials are independent; that is, the outcome of any particular trial is not affected 
by the outcome of any other trial. 


EXAMPLE 4.3.1 


We are interested in being able to compute the probability of x successes in n Bernoulli 
trials. For example, if we examine all birth records from the North Carolina State Center for 
Health Statistics (A-3) for the calendar year 2001, we find that 85.8 percent of the 
pregnancies had delivery in week 37 or later. We will refer to this as a full-term birth. With 
that percentage, we can interpret the probability of a recorded birth in week 37 or later as 
.858. If we randomly select five birth records from this population, what is the probability 
that exactly three of the records will be for full-term births? 
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Solution: 


Let us designate the occurrence of a record for a full-term birth (F) as a 
"success," and hasten to add that a premature birth (P) is not a failure, but 
medical research indicates that children born in week 36 or sooner are at risk 
for medical complications. If we are looking for birth records of premature 
deliveries, these would be designated successes, and birth records of full-term 
would be designated failures. 

It will also be convenient to assign the number 1 to a success (record for 
a full-term birth) and the number 0 to a failure (record of a premature birth). 

The process that eventually results in a birth record we consider to be a 
Bernoulli process. 

Suppose the five birth records selected resulted in this sequence of full- 
term births: 

FPFFP 


In coded form we would write this as 
10110 


Since the probability of a success is denoted by p and the probability of 
a failure is denoted by q, the probability of the above sequence of outcomes is 
found by means of the multiplication rule to be 


P(1,0,1,1,0) = pqppq = Фр" 


The multiplication rule is appropriate for computing this probability since we 
are seeking the probability of a full-term, and a premature, and a full-term, 
and a full-term, and a premature, in that order or, in other words, the joint 
probability of the five events. For simplicity, commas, rather than intersection 
notation, have been used to separate the outcomes of the events in the 
probability statement. 

The resulting probability is that of obtaining the specific sequence of 
outcomes in the order shown. We are not, however, interested in the order of 
occurrence of records for full-term and premature births but, instead, as has 
been stated already, the probability of the occurrence of exactly three records of 
full-term births out of five randomly selected records. Instead of occurring in 
the sequence shown above (call it sequence number 1), three successes and two 
failures could occur in any one of the following additional sequences as well: 


Number Sequence 
2 11100 
3 10011 
4 11010 
5 11001 
6 10101 
7 01110 
8 00111 
9 01011 
10 01101 
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Each of these sequences has the same probability of occurring, and this 
probability is equal to q?p?, the probability computed for the first sequence 
mentioned. 

When we draw a single sample of size five from the population 
specified, we obtain only one sequence of successes and failures. The 
question now becomes, What is the probability of getting sequence number 
1 or sequence number 2 ... or sequence number 10? From the addition rule 
we know that this probability is equal to the sum of the individual probabili- 
ties. In the present example we need to sum the 10g?p?'s or, equivalently, 
multiply 42р? by 10. We may now answer our original question: What is the 
probability, in a random sample of size 5, drawn from the specified popula- 
tion, of observing three successes (record of a full-term birth) and two failures 
(record of a premature birth)? Since in the population, p — .858,q = 
(1 — p) = (1 — .858) — .142 the answer to the question is 


10(.142)°(.858)? = 10(.0202)(.6316) = .1276 
m 


Large Sample Procedure: Use of Combinations We can easily 
anticipate that, as the size of the sample increases, listing the number of sequences 
becomes more and more difficult and tedious. What is needed is an easy method of 
counting the number of sequences. Such a method is provided by means of a counting 
formula that allows us to determine quickly how many subsets of objects can be formed 
when we use in the subsets different numbers of the objects that make up the set from which 
the objects are selected. When the order of the objects in a subset is immaterial, the subset 
is called a combination of objects. When the order of objects in a subset does matter, we 
refer to the subset as a permutation of objects. Though permutations of objects are often 
used in probability theory, they will not be used in our current discussion. If a set consists of 
n objects, and we wish to form a subset of x objects from these n objects, without regard to 
the order of the objects in the subset, the result is called a combination. For examples, we 
define a combination as follows when the combination is formed by taking x objects from a 
set of n objects. 


DEFINITION 


A combination of n objects taken x at a time is an unordered subset of x 
of the n objects. 


The number of combinations of n objects that can be formed by taking x of them at a 
time is given by 


n! 


„С, = (4.3.1) 


x!(n — x)! 
where x!, read x factorial, is the product of all the whole numbers from x down to 1. That is, 
x! = x(x — 1)(x— 2)... (1). We note that, by definition, 0! = 1. 

Let us return to our example in which we have a sample of n — 5 birth records and we 
are interested in finding the probability that three of them will be for full-term births. 
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TABLE 4.3.1 The Binomial Distribution 


Number of Successes, x Probability, f(x) 


0 nCoq" ° p? 
1 „Сл 4 р! 
2 „С24"? р? 
x Са" ^p 
n nCn qn p" 


Total 1 


The number of sequences in our example is found by Equation 4.3.1 to be 


5! 5.4.3.2.1 120 
„Сз = = =——=10 
POS (GE VOD 12 


In our example we let x — 3, the number of successes, so that n — x — 2, the number 
of failures. We then may write the probability of obtaining exactly x successes in п trials as 


f(x) = Са = nCyp'q"* forx = 0,1,2,...,n (4.3.2) 


= 0, elsewhere 


This expression is called the binomial distribution. In Equation 4.3.2 f(x) = Р(Х = x), 
where X is the random variable, the number of successes in n trials. We use f(x) rather 
than P(X — x) because of its compactness and because of its almost universal use. 

We may present the binomial distribution in tabular form as in Table 4.3.1. 

We establish the fact that Equation 4.3.2 is a probability distribution by showing the 
following: 


1. f(x) > 0 for all real values of x. This follows from the fact that n and p are both 
nonnegative and, hence, „Cy, p*, and (1 — p)" аге all nonnegative and, therefore, 
their product is greater than or equal to zero. 


2. > f(x) = 1. This is seen to be true if we recognize that > ^, С,4" "р" is equal to 
[1 — p) + pl = 1" = 1, the familiar binomial expansion. If the binomial (q + p)" is 
expanded, we have 


n(n—1 
(q - p)' = 4 + nq" p! + ( 5 ) ph 4... nglp' 4 p 


If we compare the terms in the expansion, term for term, with the f(x) in Table 4.3.1 
we see that they are, term for term, equivalent, since 


FO) = 4699 p* = q" 
f(1) = „Cig p! = па" Пр 
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n(n—1) ,. 
10) = Са" р? = = 2р? 


f(n) = „Сп "р" = p" 


ЕХАМРІЕ 4.3.2 


As another example of the use of the binomial distribution, the data from the North 
Carolina State Center for Health Statistics (A-3) show that 14 percent of mothers admitted 
to smoking one or more cigarettes per day during pregnancy. If a random sample of size 10 
is selected from this population, what is the probability that it will contain exactly four 
mothers who admitted to smoking during pregnancy? 


Solution: We take the probability of a mother admitting to smoking to be .14. Using 
Equation 4.3.2 we find 
РА) = 10Ca(.86)(.14)* 
_ 10! 
= qe 
= .0326 п 


.4045672)(.0003842) 


Binomial Table The calculation of a probability using Equation 4.3.2 can be a 
tedious undertaking if the sample size is large. Fortunately, probabilities for different 
values of n, p, and x have been tabulated, so that we need only to consult an appropriate 
table to obtain the desired probability. Table B of the Appendix is one of many such tables 
available. It gives the probability that X is less than or equal to some specified value. That 
is, the table gives the cumulative probabilities from x — 0 up through some specified 
positive number of successes. 

Let us illustrate the use of the table by using Example 4.3.2, where it was desired to 
find the probability that x — 4 when n — 10 and p — .14. Drawing on our knowledge of 
cumulative probability distributions from the previous section, we know that P(x — 4) may 
be found by subtracting P(X < 3) from P(X x 4). If in Table B we locate p — .14 for 
n — 10, we find that P(X < 4) — .9927 and P(X x 3) — .9600. Subtracting the latter from 
the former gives .9927 — .9600 — .0327, which nearly agrees with our hand calculation 
(discrepancy due to rounding). 

Frequently we are interested in determining probabilities, not for specific values of 
X, but for intervals such as the probability that X is between, say, 5 and 10. Let us illustrate 
with an example. 


EXAMPLE 4.3.3 


Suppose it is known that 10 percent of a certain population is color blind. If a random 
sample of 25 people is drawn from this population, use Table B in the Appendix to find the 
probability that: 


(a) Five or fewer will be color blind. 
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Solution: This probability is an entry in the table. No addition or subtraction is 
necessary, P(X < 5) — .9666. 


(b) Six or more will be color blind. 


Solution: We cannot find this probability directly in the table. To find the answer, we 
use the concept of complementary probabilities. The probability that six or 
more are color blind is the complement of the probability that five or fewer 
are color blind. That is, this set is the complement of the set specified in part 
a; therefore, 


Р(Х > 6) = 1 — P(X < 5) = 1 — .9666 = .0334 


(c) Between six and nine inclusive will be color blind. 


Solution: We find this by subtracting the probability that X is less than or equal to 5 
from the probability that X is less than or equal to 9. That is, 


P(6 < X < 9) = Р(Х < 9) — Р(Х < 5) = .9999 — .9666 = .0333 


(d) Two, three, or four will be color blind. 


Solution: This is the probability that X is between 2 and 4 inclusive. 


P(2 < X < 4) = Р(Х < 4) - Р(Х € 1) = .9020 — 2712 = .6308 


Using Table B When p > 5 Table B does not give probabilities for values of p 
greater than .5. We may obtain probabilities from Table B, however, by restating the 
problem in terms of the probability of a failure, 1 — p, rather than in terms of the probability 
of a success, p. Аз part of the restatement, we must also think in terms of the number of 
failures, n — x, rather than the number of successes, x. We may summarize this idea 
as follows: 


P(X = x\|n,p > 50) = P(X 2 n — x|n, 1 — р) (4.3.3) 


In words, Equation 4.3.3 says, "The probability that X is equal to some specified value 
given the sample size and a probability of success greater than .5 is equal to the probability 
that X is equal to n — x given the sample size and the probability of a failure of 1 — p." For 
purposes of using the binomial table we treat the probability of a failure as though it were 
the probability of a success. When p is greater than .5, we may obtain cumulative 
probabilities from Table B by using the following relationship: 


Р(Х € x|n,p > .50) = P(X 2 n — x|n, 1 — p) (4.3.4) 


Finally, to use Table B to find the probability that X is greater than or equal to some x when 
Р > .5, we use the following relationship: 


Р(Х > x|n,p > 50) = Р(Х € n— х|п,1 — p) (4.3.5) 
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EXAMPLE 4.3.4 


According to a June 2003 poll conducted by the Massachusetts Health Benchmarks project 
(A-4), approximately 55 percent of residents answered "serious problem" to the question, 
"Some people think that childhood obesity is a national health problem. What do you 
think? Is it a very serious problem, somewhat of a problem, not much of a problem, or not a 
problem at all?" Assuming that the probability of giving this answer to the question is .55 
for any Massachusetts resident, use Table B to find the probability that if 12 residents are 
chosen at random: 


(a) Exactly seven will answer "serious problem." 


Solution: We restate the problem as follows: What is the probability that a randomly 
selected resident gives an answer other than "serious problem" from exactly 
five residents out of 12, if 45 percent of residents give an answer other than 
"serious problem." We find the answer as follows: 


Р(Х = 5|n = 12,p = 45) = P(X < 5) — Р(Х < 4) 
= .5269 — .3044 = .2225 


(b) Five or fewer households will answer “serious problem.” 


Solution: The probability we want is 


P(X < 5|п = 12, p = .55) = Р(Х > 12 - 5|п = 12, p = 45) 
Р(Х > 7|п = 12, p = .45) 

= 1— Р(Х < 6|п = 12, p = 45) 
= 1 — .7393 = .2607 


(c) Eight or more households will answer “serious problem.” 


Solution: The probability we want is 


P(X > 8|n = 12,р = 55) = P(X < Ап = 12,p = 45) = 3044 


Figure 4.3.1 provides a visual representation of the solution to the three parts of 
Example 4.3.4. 


The Binomial Parameters Тһе binomial distribution has two parameters, n and 
p. They are parameters in the sense that they are sufficient to specify a binomial 
distribution. The binomial distribution is really a family of distributions with each possible 
value of n and p designating a different member of the family. The mean and variance of the 
binomial distribution are м = np and o? = np(1 — p), respectively. 

Strictly speaking, the binomial distribution is applicable in situations where sam- 
pling is from an infinite population or from a finite population with replacement. Since 
in actual practice samples are usually drawn without replacement from finite populations, 
the question arises as to the appropriateness of the binomial distribution under these 
circumstances. Whether or not the binomial is appropriate depends on how drastic the 
effect of these conditions is on the constancy of p from trial to trial. It is generally agreed 
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Possible number Possible number 

of successes of failures 

(serious) 2 x Probability (not serious) = n — x Probability 
P(SUCCESS) = 55 statement P(FAILURE) = .45 statement 


Part b 


Part a 


Part c 


P(X = 5|12, .55) P(X = 7|12, .45) 


6 

C» P(X = 7|12, .55) 
8 
9 
10 
11 
12 


P(X = 5|12, .45) 


A 
- 
IV 


8|12, .55) 4|12, .45] 


Сньодбебезуні 
ны 
ty 
р 
lA 


FIGURE 4.3.1 Schematic representation of solutions to Example 4.3.4 (the relevant numbers 
of successes and failures in each case are circled). 


that when n is small relative to N, the binomial model is appropriate. Some writers say that 
n is small relative to N if N is at least 10 times as large as n. 

Most statistical software programs allow for the calculation of binomial probabilities 
with a personal computer. EXCEL, for example, can be used to calculate individual or 
cumulative probabilities for specified values of x, n, and p. Suppose we wish to find the 
individual probabilities for x = 0 through x = 6 when n = 6 and p = .3. We enter the 
numbers 0 through 6 in Column 1 and proceed as shown in Figure 4.3.2. We may follow a 
similar procedure to find the cumulative probabilities. For this illustration, we use MINITAB 
and place the numbers 1 through 6 in Column 1. We proceed as shown in Figure 4.3.3. 


Using the following cell command: 
BINOM DIST (A*, 6, .3, false), where A* is the appropriate cell reference 
We obtain the following output: 


0 0.117649 
0.302526 
0.324135 
0.185220 
0.059535 
0.010206 
0.000729 


ом > 


FIGURE 4.3.2 Excel calculation of individual binomial probabilities for x = 0 through x = 6 
when n= бапа р = 3. 
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Dialog box: Session command: 


Calc » Probability Distributions » MTB » CDF C1; 
Binomial SUBC> BINOMIAL 6 0.3. 


Choose Cumulative probability. Type Gin Number of 
trials. Type 0.3 in Probability of success. Choose 
Input column and type C1. Click OK. 


Output: 
Cumulative Distribution Function 
Binomial with n = 6 and p = 0.300000 


P( X <= x) 
.1176 
.4202 
.7443 
.9295 
.9891 
.9993 
.0000 


FIGURE 4.3.3 МІМІТАВ calculation of cumulative binomial probabilities for x = 0 through x = 
6 when пл = 6 and р = 3. 


EXERCISES 


In each of the following exercises, assume that N is sufficiently large relative to n that the 
binomial distribution may be used to find the desired probabilities. 


4.3.1 Based on data collected by the National Center for Health Statistics and made available to the public 
in the Sample Adult database (A-5), an estimate of the percentage of adults who have at some point in 
their life been told they have hypertension is 23.53 percent. If we select a simple random sample of 20 
U.S. adults and assume that the probability that each has been told that he or she has hypertension is 
224, find the probability that the number of people in the sample who have been told that they have 
hypertension will be: 


(a) Exactly three (b) Three or more 
(c) Fewer than three (d) Between three and seven, inclusive 
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4.3.2. Refer to Exercise 4.3.1. How many adults who have been told that they have hypertension would you 
expect to find in a sample of 20? 


4.3.3 Refer to Exercise 4.3.1. Suppose we select a simple random sample of five adults. Use Equation 4.3.2 
to find the probability that, in the sample, the number of people who have been told that they have 
hypertension will be: 


(a) Zero (b) More than one 
(c) Between one and three, inclusive (d) Two or fewer 
(e) Five 


4.3.4 The same survey database cited in exercise 4.3.1 (A-5) shows that 32 percent of U.S. adults indicated 
that they have been tested for HIV at some point in their life. Consider a simple random sample of 15 
adults selected at that time. Find the probability that the number of adults who have been tested for 
HIV in the sample would be: 


(a) Three (b) Less than five 
(c) Between five and nine, inclusive (d) More than five, but less than 10 
(e) Six or more 


4.3.5 Refer to Exercise 4.3.4. Find the mean and variance of the number of people tested for HIV in samples 
of size 15. 


4.3.6 Refer to Exercise 4.3.4. Suppose we were to take a simple random sample of 25 adults today and find 
that two have been tested for HIV at some point in their life. Would these results be surprising? Why 
or why not? 


4.3.7 Coughlin et al. (A-6) estimated the percentage of women living in border counties along the southern 
United States with Mexico (designated counties in California, Arizona, New Mexico, and Texas) who 
have less than a high school education to be 18.7. Assume the corresponding probability is .19. 
Suppose we select three women at random. Find the probability that the number with less than a high- 
school education is: 


(a) Exactly zero (b) Exactly one 
(c) More than one (d) Two or fewer 
(e) Two or three (f) Exactly three 


4.3.8 Ina survey of nursing students pursuing a master's degree, 75 percent stated that they expect to be 
promoted to a higher position within one month after receiving the degree. If this percentage holds for 
the entire population, find, for a sample of 15, the probability that the number expecting a promotion 
within a month after receiving their degree is: 


(a) Six (b) At least seven 
(c) No more than five (d) Between six and nine, inclusive 


4.3.9 Given the binomial parameters p — .8 and n — 3, show by means of the binomial expansion given in 
Table 4.3.1 that $^ f(x) = 1. 


4.4 THE POISSON DISTRIBUTION 


The next discrete distribution that we consider is the Poisson distribution, named for the 
French mathematician Simeon Denis Poisson (1781-1840), who is generally credited for 
publishing its derivation in 1837. This distribution has been used extensively as a 
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probability model in biology and medicine. Haight (1) presents a fairly extensive catalog of 
such applications in Chapter 7 of his book. 

If x is the number of occurrences of some random event in an interval of time or space 
(or some volume of matter), the probability that x will occur is given by 


f(x) = ‚ х=0,1,2,... (44.1) 


x! 


The Greek letter à (lambda) is called the parameter of the distribution and is the 
average number of occurrences of the random event in the interval (or volume). The symbol 
e is the constant (to four decimals) 2.7183. 

It can be shown that f(x) > 0 for every x and that » f(x) = 1 so that the distribution 
satisfies the requirements for a probability distribution. 


The Poisson Process We have seen that the binomial distribution results from a 
set of assumptions about an underlying process yielding a set of numerical observations. 
Such, also, is the case with the Poisson distribution. The following statements describe 
what is known as the Poisson process. 


1. The occurrences of the events are independent. The occurrence of an event in an 
interval! of space or time has no effect on the probability of a second occurrence of 
the event in the same, or any other, interval. 


2. Theoretically, an infinite number of occurrences of the event must be possible in the 
interval. 


3. The probability of the single occurrence of the event in a given interval is 
proportional to the length of the interval. 


4. In any infinitesimally small portion of the interval, the probability of more than one 
occurrence of the event is negligible. 


An interesting feature of the Poisson distribution is the fact that the mean and 
variance are equal. Both are represented by the symbol A. 


When to Use the Poisson Model The Poisson distribution is employed 
as a model when counts are made of events or entities that are distributed at random 
in space or time. One may suspect that a certain process obeys the Poisson law, and 
under this assumption probabilities of the occurrence of events or entities within some 
unit of space or time may be calculated. For example, under the assumptions that the 
distribution of some parasite among individual host members follows the Poisson 
law, one may, with knowledge of the parameter A, calculate the probability that a 
randomly selected individual host will yield x number of parasites. In a later chapter we 
will learn how to decide whether the assumption that a specified process obeys the 
Poisson law is plausible. An additional use of the Poisson distribution in practice occurs 
when 7 is large and p is small. In this case, the Poisson distribution can be used to 


! For simplicity, the Poisson distribution is discussed in terms of intervals, but other units, such as a volume of 
matter, are implied. 
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approximate the binomial distribution. In other words, 


A yx 
quie A Bon 
X: 


where А = пр. 
To illustrate the use of the Poisson distribution for computing probabilities, let us 
consider the following examples. 


EXAMPLE 4.4.1 


In a study of drug-induced anaphylaxis among patients taking rocuronium bromide as part 
of their anesthesia, Laake and Røttingen (A-7) found that the occurrence of anaphylaxis 
followed a Poisson model with à = 12 incidents per year in Norway. Find the probability 
that in the next year, among patients receiving rocuronium, exactly three will experience 
anaphylaxis. 


Solution: By Equation 4.4.1, we find the answer to be 


pue 
у = 00177 
3! в 


Р(Х = 3) = 


EXAMPLE 4.4.2 


Refer to Example 4.4.1. What is the probability that at least three patients in the next year 
will experience anaphylaxis if rocuronium is administered with anesthesia? 


Solution: We can use the concept of complementary events in this case. Since P(X < 2) 
is the complement of P(X > 3), we have 


P(X > 3) = 1 — P(X < 2) = 1 — [P(X = 0) + P(X = 1) + P(X = 2)] 
e 212? e 12! e 12122 
pc. i a 
= 1 — [.00000614 + 00007373 + .00044238] 
= 1 — 00052225 
= 99947775 


In the foregoing examples the probabilities were evaluated directly from the equation. 
We may, however, use Appendix Table C, which gives cumulative probabilities for various 
values of A and X. 


EXAMPLE 4.4.3 


In the study of a certain aquatic organism, a large number of samples were taken from a 
pond, and the number of organisms in each sample was counted. The average number of 
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organisms per sample was found to be two. Assuming that the number of organisms follows 
a Poisson distribution, find the probability that the next sample taken will contain one or 
fewer organisms. 

Solution: In Table C we see that when à = 2, the probability that X < 115.406. That is, 
P(X < 1|2) = .406. ш 


EXAMPLE 4.4.4 


Refer to Example 4.4.3. Find the probability that the next sample taken will contain exactly 
three organisms. 


Solution: 


P(X = 3|2) = Р(Х < 3) — P(X < 2) = .857 — .677 = 180 


Data: 
C1: 0123456 
Dialog box: Session command: 


Calc » Probability Distributions » Poisson MTB > PDF Cl; 
SUBC> Poisson .70. 


Choose Probability. Type .70 in Mean. Choose Input column and 
type C1. Click OK. 


Output: 
Probability Density Function 
Poisson with mu = 0.700000 


P( X = x) 
.4966 
.3476 
.1217 
.0284 
.0050 
.0007 
.0001 


FIGURE 4.4.1 MINITAB calculation of individual Poisson probabilities for x = 0 through x = 6 
and \=.7. 
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Using commands found in: 


Analysis » Other » Probability Calculator 


We obtain the following output: 


Prob(x <= X) 


FIGURE 4.4.2 MINITAB calculation of cumulative Poisson probabilities for x = 0 
through x = 6 and A = 7. 


EXAMPLE 4.4.5 


Refer to Example 4.4.3. Find the probability that the next sample taken will contain more 
than five organisms. 


Solution: Since the set of more than five organisms does not include five, we are asking 
for the probability that six or more organisms will be observed. This is 
obtained by subtracting the probability of observing five or fewer from one. 
That is, 


Р(Х > 5/2) = 1— P(X < 5) = 1 — .983 = .017 
ш 


Poisson probabilities are obtainable from most statistical software packages. To illustrate 
the use of MINITAB for this purpose, suppose we wish to find the individual probabilities 
for x = O through x = 6 when à = .7. We enter the values of x in Column 1 and proceed as 
shown in Figure 4.4.1. We obtain the cumulative probabilities for the same values of x апа 2. 
as shown in Figure 4.4.2 . 


EXERCISES 


4.4.1 Singh et al. (A-8) looked at the occurrence of retinal capillary hemangioma (RCH) in patients with 
von Hippel-Lindau (VHL) disease. RCH is a benign vascular tumor of the retina. Using a 
retrospective consecutive case series review, the researchers found that the number of RCH tumor 
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incidents followed a Poisson distribution with A = 4 tumors per eye for patients with VHL. Using this 
model, find the probability that in a randomly selected patient with VHL: 


(a) There are exactly five occurrences of tumors per eye. 
(b) There are more than five occurrences of tumors per eye. 
(c) There are fewer than five occurrences of tumors per eye. 


(d) There are between five and seven occurrences of tumors per eye, inclusive. 


4.4.2 Tubert-Bitter et al. (A-9) found that the number of serious gastrointestinal reactions reported to 
the British Committee on Safety of Medicine was 538 for 9,160,000 prescriptions of the anti- 
inflammatory drug piroxicam. This corresponds to a rate of .058 gastrointestinal reactions per 1000 
prescriptions written. Using a Poisson model for probability, with 2 = .06, find the probability of 
(a) Exactly one gastrointestinal reaction in 1000 prescriptions 
(b) Exactly two gastrointestinal reactions in 1000 prescriptions 
(c) No gastrointestinal reactions in 1000 prescriptions 


(d) At least one gastrointestinal reaction in 1000 prescriptions 


4.4.3 If the mean number of serious accidents per year in a large factory (where the number of employees 
remains constant) is five, find the probability that in the current year there will be: 


(a) Exactly seven accidents (b) Ten or more accidents 
(c) No accidents (d) Fewer than five accidents 


44.4 In a study of the effectiveness of an insecticide against a certain insect, a large area of land was 
sprayed. Later the area was examined for live insects by randomly selecting squares and counting the 
number of live insects per square. Past experience has shown the average number of live insects per 
square after spraying to be .5. If the number of live insects per square follows a Poisson distribution, 
find the probability that a selected square will contain: 


(a) Exactly one live insect (b) No live insects 
(c) Exactly four live insects (d) One or more live insects 


4.4.5 Inacertain population an average of 13 new cases of esophageal cancer are diagnosed each year. If 
the annual incidence of esophageal cancer follows a Poisson distribution, find the probability that in a 
given year the number of newly diagnosed cases of esophageal cancer will be: 


(a) Exactly 10 (b) At least eight 
(c) No more than 12 (d) Between nine and 15, inclusive 
(e) Fewer than seven 


4.5 CONTINUOUS PROBABILITY 
DISTRIBUTIONS 


The probability distributions considered thus far, the binomial and the Poisson, are dis- 
tributions of discrete variables. Let us now consider distributions of continuous random 
variables. In Chapter 1 we stated that a continuous variable is one that can assume any 
value within a specified interval of values assumed by the variable. Consequently, 
between any two values assumed by a continuous variable, there exist an infinite number 
of values. 
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To help us understand the nature of the distribution of a continuous random variable, 
let us consider the data presented in Table 1.4.1 and Figure 2.3.2. In the table we have 189 
values of the random variable, age. The histogram of Figure 2.3.2 was constructed by 
locating specified points on a line representing the measurement of interest and erecting a 
series of rectangles, whose widths were the distances between two specified points on the 
line, and whose heights represented the number of values of the variable falling between 
the two specified points. The intervals defined by any two consecutive specified points we 
called class intervals. As was noted in Chapter 2, subareas of the histogram correspond to 
the frequencies of occurrence of values of the variable between the horizontal scale 
boundaries of these subareas. This provides a way whereby the relative frequency of 
occurrence of values between any two specified points can be calculated: merely determine 
the proportion of the histogram's total area falling between the specified points. This can be 
done more conveniently by consulting the relative frequency or cumulative relative 
frequency columns of Table 2.3.2. 

Imagine now the situation where the number of values of our random variable is very 
large and the width of our class intervals is made very small. The resulting histogram could 
look like that shown in Figure 4.5.1. 

If we were to connect the midpoints of the cells of the histogram in Figure 4.5.1 to 
form a frequency polygon, clearly we would have a much smoother figure than the 
frequency polygon of Figure 2.3.4. 

In general, as the number of observations, n, approaches infinity, and the width of the 
class intervals approaches zero, the frequency polygon approaches a smooth curve such as 
is shown in Figure 4.5.2. Such smooth curves are used to represent graphically the 
distributions of continuous random variables. This has some important consequences when 
we deal with probability distributions. First, the total area under the curve is equal to one, as 
was true with the histogram, and the relative frequency of occurrence of values between 
any two points on the x-axis is equal to the total area bounded by the curve, the x-axis, 
and perpendicular lines erected at the two points on the x-axis. See Figure 4.5.3. The 


f(x) 


FIGURE 4.5.1 A histogram resulting from a large number of values 
and small class intervals. 
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x 


FIGURE 4.5.2 Graphical representation of a continuous 
distribution. 


probability of any specific value of the random variable is zero. This seems logical, since a 
specific value is represented by a point on the x-axis and the area above a point is zero. 


Finding Area Under a Smooth Curve With a histogram, as we have seen, 
subareas of interest can be found by adding areas represented by the cells. We have no cells 
in the case of a smooth curve, so we must seek an alternate method of finding subareas. 
Such a method is provided by the integral calculus. To find the area under a smooth curve 
between any two points a and b, the density function is integrated from a to b. A density 
function is a formula used to represent the distribution of a continuous random variable. 
Integration is the limiting case of summation, but we will not perform any integrations, 
since the level of mathematics involved is beyond the scope of this book. As we will see 
Jater, for all the continuous distributions we will consider, there will be an easier way to find 
areas under their curves. 

Although the definition of a probability distribution for a continuous random variable 
has been implied in the foregoing discussion, by way of summary, we present it in a more 
compact form as follows. 


DEFINITION 


A nonnegative function f (x) is called a probability distribution 
(sometimes called a probability density function) of the continuous 
random variable X if the total area bounded by its curve and the x -axis is 
equal to 1 and if the subarea under the curve bounded by the curve, the 

x -axis, and perpendiculars erected at any two points a and b give the 
probability that X is between the points a and b. 


a b x 


FIGURE 4.5.3 Graph of a continuous distribution 
showing area between a and b. 
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Thus, the probability of a continuous random variable to assume values between a 
and b is denoted by P(a « X « b). 


4.6 THENORMAL DISTRIBUTION 


We come now to the most important distribution in all of statistics—the normal dis- 
tribution. The formula for this distribution was first published by Abraham De Moivre 
(1667-1754) on November 12, 1733. Many other mathematicians figure prominently in 
the history of the normal distribution, including Carl Friedrich Gauss (1777-1855). The 
distribution is frequently called the Gaussian distribution in recognition of his 
contributions. 

The normal density is given by 


Ln 


MM 


In Equation 4.6.1, л and e are the familiar constants, 3.14159 ... and 2.71828 
. . . , respectively, which are frequently encountered in mathematics. The two parameters 
of the distribution are u, the mean, and o, the standard deviation. For our purposes we may 
think of u and с of a normal distribution, respectively, as measures of central tendency and 
dispersion as discussed in Chapter 2. Since, however, a normally distributed random 
variable is continuous and takes on values between —oo and +00, its mean and standard 
deviation may be more rigorously defined; but such definitions cannot be given without 
using calculus. The graph of the normal distribution produces the familiar bell-shaped 
curve shown in Figure 4.6.1. 


—oo«x«oo (4.6.1) 


Characteristics of the Normal Distribution The following are some 
important characteristics of the normal distribution. 


1. It is symmetrical about its mean, jz. As is shown in Figure 4.6.1, the curve on either 
side of и is a mirror image of the other side. 

2. The mean, the median, and the mode are all equal. 

3. The total area under the curve above the x-axis is one square unit. This characteristic 
follows from the fact that the normal distribution is a probability distribution. 
Because of the symmetry already mentioned, 50 percent of the area is to the right 
of a perpendicular erected at the mean, and 50 percent is to the left. 


m x 
FIGURE 4.6.1 Graph of a normal distribution. 
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.16 lo 10 16 


и-1с и u+1o х 
(а) 


4-30 u 1+30 х 


FIGURE 4.6.2 Subdivision of the area under the normal curve 
(areas are approximate). 


4. If we erect perpendiculars a distance of 1 standard deviation from the mean in both 
directions, the area enclosed by these perpendiculars, the x-axis, and the curve will be 
approximately 68 percent of the total area. If we extend these lateral boundaries a 
distance of two standard deviations on either side of the mean, approximately 
95 percent of the area will be enclosed, and extending them a distance of three 
standard deviations will cause approximately 99.7 percent of the total area to be 
enclosed. These approximate areas are illustrated in Figure 4.6.2. 


5. The normal distribution is completely determined by the parameters jz and с. In other 
words, a different normal distribution is specified for each different value of и and o. 
Different values of yu shift the graph of the distribution along the x-axis as is shown in 
Figure 4.6.3. Different values of с determine the degree of flatness or peakedness of 
the graph of the distribution as is shown in Figure 4.6.4. Because of the character- 
istics of these two parameters, и is often referred to as a location parameter and o is 
often referred to as a shape parameter. 
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My Ma Шз x 
Hy < My < Из 


FIGURE 4.6.3 Three normal distributions with different means but the same amount of 
variability. 


01 


0 


03 


01 < 0) < 03 X 


FIGURE 4.6.4 Three normal distributions with different standard deviations but the 
same mean. 


The Standard Normal Distribution The last-mentioned characteristic 
of the normal distribution implies that the normal distribution is really a family of 
distributions in which one member is distinguished from another on the basis of the 
values of и and о. The most important member of this family is the standard normal 
distribution or unit normal distribution, as it is sometimes called, because it has a mean of 
0 and a standard deviation of 1. It may be obtained from Equation 4.6.1 by creating a 
random variable. 


z=(x-p)/o (4.6.2) 


The equation for the standard normal distribution is written 


1 
у) = e*?  —oocz«oo (4.6.3) 


The graph of the standard normal distribution is shown in Figure 4.6.5. 

The z-transformation will prove to be useful in the examples and applications that 
follow. This value of z denotes, for a value of a random variable, the number of standard 
deviations that value falls above (+2) or below (—z) the mean, which in this case is 0. For 
example, a z-transformation that yields a value of z — 1 indicates that the value of x used in 
the transformation is 1 standard deviation above O. A value of z — —1 indicates that the 
value of x used in the transformation is 1 standard deviation below 0. This property is 
illustrated in the examples of Section 4.7. 
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и=0 2 
FIGURE 4.6.5 The standard normal distribution. 


0 Zo 2 
FIGURE 4.6.6 Агеа given by Appendix Table D. 


To find the probability that z takes on a value between any two points on the z-axis, 
say, zo and 21, we must find the area bounded by perpendiculars erected at these points, the 
curve, and the horizontal axis. As we mentioned previously, areas under the curve of a 
continuous distribution are found by integrating the function between two values of the 
variable. In the case of the standard normal, then, to find the area between zo and z; directly, 
we would need to evaluate the following integral: 


a 5 
-2/ q 
€ Z 
| ул 


Although а closed-form solution for the integral does not exist, we can use numerical 
methods of calculus to approximate the desired areas beneath the curve to a desired 
accuracy. Fortunately, we do not have to concern ourselves with such matters, since there 
are tables available that provide the results of any integration in which we might be 
interested. Table D in the Appendix is an example of these tables. In the body of Table D are 
found the areas under the curve between —oo and the values of z shown in the leftmost 
column of the table. The shaded area of Figure 4.6.6 represents the area listed in the table as 
being between —oo and zo, where zo is the specified value of z. 

We now illustrate the use of Table D by several examples. 


EXAMPLE 4.6.1 


Given the standard normal distribution, find the area under the curve, above the z-axis 
between z — —oo and z — 2. 
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0 2 7 


FIGURE 4.6.7 The standard normal distribution showing 
area between z — —oo and z — 2. 


Solution: 


It will be helpful to draw a picture of the standard normal distribution and 
shade the desired area, as in Figure 4.6.7. If we locate z — 2 in Table D and 
read the corresponding entry in the body of the table, we find the desired area 
to be .9772. We may interpret this area in several ways. We may interpret it as 
the probability that a z picked at random from the population of z's will have a 
value between —oo and 2. We may also interpret it as the relative frequency of 
occurrence (or proportion) of values of z between —oo and 2, or we may say 
that 97.72 percent of the z's have a value between —oo and 2. A 


EXAMPLE 4.6.2 


What is the probability that a z picked at random from the population of z's will have a 
value between —2.55 and 4-2.55? 


Solution: 


Figure 4.6.8 shows the area desired. Table D gives us the area between —oo 
and 2.55, which is found by locating 2.5 in the leftmost column of the table 
and then moving across until we come to the entry in the column headed by 
0.05. We find this area to be .9946. If we look at the picture we draw, we see 
that this is more area than is desired. We need to subtract from .9946 the area 
to the left of —2.55. Reference to Table D shows that the area to the left of 
—2.55 is .0054. Thus the desired probability is 


P(—2.55 « z « 2.55) = .9946 — .0054 = .9892 


-2.55 0 2.55 х 


FIGURE 4.6.8 Standard normal curve showing 
P(—2.55 < z « 2.55). a 
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-2.74 0 1.53 2 


FIGURE 4.6.9 Standard normal curve showing proportion of 
z values between z — —2.74 and z — 1.53. 


Suppose we had been asked to find the probability that z is between —2.55 and 2.55 
inclusive. The desired probability is expressed as P(—2.55 < z < 2.55). Since, as we noted 
in Section 4.5, P(z = zo) = 0, Р( -2.55 < z 2.55) = P(—2.55 < z < 2.55) = .9892. 
EXAMPLE 4.6.3 

What proportion of z values are between —2.74 and 1.53? 

Solution: Figure 4.6.9 shows the area desired. We find in Table D that the area between 


—oo and 1.53 is .9370, and the area between —oo and —2.74 is .0031. To 
obtain the desired probability we subtract .0031 from .9370. That is, 


P(—2.74 < z < 1.53) = .9370 — .0031 = .9339 ш 


EXAMPLE 4.6.4 
Given the standard normal distribution, find P(z > 2.71). 


Solution: The area desired is shown in Figure 4.6.10. We obtain the area to the right of 
z = 2.71 by subtracting the area between —oo and 2.71 from 1. Thus, 


P(z > 2.71) = 1 — P(z < 2.71) 


= 1 — .9966 
= .0034 
0 2.71 2 
FIGURE 4.6.10 Standard normal distribution showing 


P(z » 2.71). 
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EXAMPLE 4.6.5 


Given the standard normal distribution, find P(.84 < z < 2.45). 


Solution: The area we are looking for is shown in Figure 4.6.11. We first obtain the area 
between —oo and 2.45 and from that subtract the area between —oo and .84. 
In other words, 
P(.84 € z 2.45) = P(z € 245) - P(z < .84) 
= .9929 — .7995 
= .1934 


| 
0 84 245 2 


FIGURE 4.6.11 Standard normal curve showing 
Р(.84 < z < 2.45). 


EXERCISES 


Given the standard normal distribution find: 
4.6.1 The area under the curve between z = 0 and z = 1.43 


4.6.2 The probability that a z picked at random will have a value between z = —2.87 and z = 2.64 


4.6.3 P(z > .55) 4.6.4 P(z > —.55) 
46.5 P(z < —2.33) 4.6.6 P(z < 2.33) 
4.6.7 P(—1.96 < z < 1.96) 4.6.8 Р(-2.58 < z < 2.58) 
4.6.9  Р(-1.65 < z < 1.65) 4.6.10 P(z = 74) 


Given the following probabilities, find 21: 
4.6.11  P(z € 21) = 0055 4.6.12 P(-2.67 < z < zı) = .9718 
4.6.13 Р(2> 21) = .0384 4.6.14 P(z < z < 2.98) = .1117 
4.6.15 P(—z < z < zı) = .8132 


4.7 NORMAL DISTRIBUTION APPLICATIONS 


Although its importance in the field of statistics is indisputable, one should realize that the 
normal distribution is not a law that is adhered to by all measurable characteristics 
occurring in nature. It is true, however, that many of these characteristics are approximately 
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normally distributed. Consequently, even though no variable encountered in practice is 
precisely normally distributed, the normal distribution can be used to model the distribu- 
tion of many variables that are of interest. Using the normal distribution as a model allows 
us to make useful probability statements about some variables much more conveniently 
than would be the case if some more complicated model had to be used. 

Human stature and human intelligence are frequently cited as examples of variables 
that are approximately normally distributed. On the other hand, many distributions relevant 
to the health field cannot be described adequately by a normal distribution. Whenever it is 
known that a random variable is approximately normally distributed, or when, in the 
absence of complete knowledge, it is considered reasonable to make this assumption, the 
statistician is aided tremendously in his or her efforts to solve practical problems relative to 
this variable. Bear in mind, however, that “normal” in this context refers to the statistical 
properties of a set of data and in no way connotes normality in the sense of health or 
medical condition. 

There are several other reasons why the normal distribution is so important in 
statistics, and these will be considered in due time. For now, let us see how we may answer 
simple probability questions about random variables when we know, or are willing to 
assume, that they are, at least, approximately normally distributed. 


EXAMPLE 4.7.1 


The Uptimer is a custom-made lightweight battery-operated activity monitor that records 
the amount of time an individual spends in the upright position. In a study of children ages 
8 to 15 years, Eldridge et al. (A-10) studied 529 normally developing children who each 
wore the Uptimer continuously for a 24-hour period that included a typical school day. The 
researchers found that the amount of time children spent in the upright position followed a 
normal distribution with a mean of 5.4 hours and standard deviation of 1.3 hours. Assume 
that this finding applies to all children 8 to 15 years of age. Find the probability that a child 
selected at random spends less than 3 hours in the upright position in a 24-hour period. 


Solution: First let us draw a picture of the distribution and shade the area corresponding 
to the probability of interest. This has been done in Figure 4.7.1. 


| 
3.0 и=5.4 

FIGURE 4.7.1 Normal distribution to approximate 

distribution of amount of time children spent in upright 

position (mean and standard deviation estimated). 
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| 2 
-1.85 0 


FIGURE 4.7.2 Normal distribution of time spent upright 
(x) and the standard normal distribution (z). 


If our distribution were the standard normal distribution with a 
mean of 0 and a standard deviation of 1, we could make use of Table D 
and find the probability with little effort. Fortunately, it is possible for 
any normal distribution to be transformed easily to the standard normal. 
What we do is transform all values of X to corresponding values of z. This 
means that the mean of X must become 0, the mean of z. In Figure 4.7.2 
both distributions are shown. We must determine what value of z, say, zo, 
corresponds to an x of 3.0. This is done using formula 4.6.2, z = (x — м)/о, 
which transforms any value of x in any normal distribution to the corre- 
sponding value of z in the standard normal distribution. For the present 
example we have 


30-54 


= - 1.85 
1.3 


The value of zo we seek, then, is — 1.85. и 


Let us examine these relationships more closely. It is seen that the distance from the 
mean, 5.4, to the x-value of interest, 3.0, is 3.0 — 5.4 — —2.4, which is a distance of 1.85 
standard deviations. When we transform x values to z values, the distance of the z value 
of interest from its mean, 0, is equal to the distance of the corresponding x value from its 
mean, 5.4, in standard deviation units. We have seen that this latter distance is 1.85 
standard deviations. In the z distribution a standard deviation is equal to 1, and 
consequently the point on the z scale located a distance of 1.85 standard deviations 
below 0 is z — — 1.85, the result obtained by employing the formula. By consulting 
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Table D, we find that the area to the left of z = —1.85 is .0322. We may summarize this 
discussion as follows: 


3.0 — 5.4 
1.3 


P(x < 3.0) = Plz < | = P(z < —1.85) = 0322 


To answer the original question, we say that the probability is .0322 that a randomly 
selected child will have uptime of less than 3.0 hours. 


EXAMPLE 4.7.2 


Diskin et al. (A-11) studied common breath metabolites such as ammonia, acetone, 
isoprene, ethanol, and acetaldehyde in five subjects over a period of 30 days. Each day, 
breath samples were taken and analyzed in the early morning on arrival at the laboratory. 
For subject A, a 27-year-old female, the ammonia concentration in parts per billion (ppb) 
followed a normal distribution over 30 days with mean 491 and standard deviation 119. 
What is the probability that on a random day, the subject's ammonia concentration is 
between 292 and 649 ppb? 


Solution: In Figure 4.7.3 are shown the distribution of ammonia concentrations and the 
z distribution to which we transform the original values to determine the 
desired probabilities. We find the z value corresponding to an x of 292 by 


292 — 491 
= = —1.67 
119 8 
o=119 
292 491 649 x 
o=1 
-1.67 0 1.33 2 


FIGURE 4.7.3 Distribution of ammonia concentration (x) апа 
the corresponding standard normal distribution (z). 
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Similarly, for x — 649 we have 


649 — 491 
Баланар 
74 119 33 


From Table D we find the area between —oo and —1.67 to be .0475 and the 
area between —oo and 1.33 to be .9082. The area desired is the difference 
between these, .9082 — .0475 = .8607. To summarize, 


292 — 491 649 — 491 
Р(292 < x < 649) = P| ————— < z < —— 
(29255640) ( 119 = 119 ) 


— P(—1.67 € z € 1.33) 
= Р(—с < z € 1.33) - P(—oo € z € —1.67) 


= 9082 — .0475 
— .8607 
The probability asked for in our original question, then, is .8607. H 


EXAMPLE 4.7.3 


In a population of 10,000 of the children described in Example 4.7.1, how many would you 
expect to be upright more than 8.5 hours? 


Solution: We first find the probability that one child selected at random from the 
population would be upright more than 8.5 hours. That is, 


8.5 — 5.4 


>8.5)=P[z> 
P(x > 8.5) ‚(с> 13 


) = P(z > 2.38) = 1 — .9913 = .0087 


Out of 10,000 people we would expect 10,000(.0087) = 87 to spend more 
than 8.5 hours upright. A 


We may use MINITAB to calculate cumulative standard normal probabilities. Suppose 
we wish to find the cumulative probabilities for the following values of z: 
—3, —2, —1,0,1,2, and 3. We enter the values of z into Column 1 and proceed as 
shown in Figure 4.7.4. 

The preceding two sections focused extensively on the normal distribution, the most 
important and most frequently used continuous probability distribution. Though much of 
what will be covered in the next several chapters uses this distribution, it is not the only 
important continuous probability distribution. We will be introducing several other 
continuous distributions later in the text, namely the t-distribution, the chi-square 
distribution, and the F-distribution. The details of these distributions will be discussed 
in the chapters in which we need them for inferential tests. 
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Data: 
C1: -3-2-10123 
Dialog box: Session command: 


Calc » Probability Distributions » Normal MTB > CDF Cl; 
SUBC> Normal 0 1. 


Choose Cumulative probability. Choose Input column 
and type C1. Click OK. 


Output: 


Cumulative Distribution Function 


Normal with mean = O0 and standard 
deviation = 1.00000 


x) 


оооооооюмк 


FIGURE 4.7.4 МІМІТАВ calculation of cumulative standard normal probabilities. 


EXERCISES 


4.7.1 For another subject (a 29-year-old male) in the study by Diskin et al. (A-11), acetone levels were 
normally distributed with a mean of 870 and a standard deviation of 211 ppb. Find the probability that 
on a given day the subject's acetone level is: 


(a) Between 600 and 1000 ppb 
(b) Over 900 ppb 

(c) Under 500 ppb 

(d) Between 900 and 1100 ppb 


4.7.2 In the study of fingerprints, an important quantitative characteristic is the total ridge count for the 
10 fingers of an individual. Suppose that the total ridge counts of individuals in a certain population 
are approximately normally distributed with a mean of 140 and a standard deviation of 50. Find the 
probability that an individual picked at random from this population will have a ridge count of: 
(a) 200 or more 


(b) Less than 100 
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4.7.3 


4.7.4 


4.7.5 


4.7.6 


4.7.7 


(c) Between 100 and 200 

(d) Between 200 and 250 

(e) In a population of 10,000 people how many would you expect to have a ridge count of 200 or 
more? 


One of the variables collected in the North Carolina Birth Registry data (A-3) is pounds gained during 
pregnancy. According to data from the entire registry for 2001, the number of pounds gained during 
pregnancy was approximately normally distributed with a mean of 30.23 pounds and a standard 
deviation of 13.84 pounds. Calculate the probability that a randomly selected mother in North 
Carolina in 2001 gained: 


(a) Less than 15 pounds during pregnancy (b) More than 40 pounds 
(c) Between 14 and 40 pounds (d) Less than 10 pounds 
(e) Between 10 and 20 pounds 


Suppose the average length of stay in a chronic disease hospital ofa certain type of patient is 60 days with 
a standard deviation of 15. Ifitis reasonable to assume an approximately normal distribution of lengths of 
stay, find the probability that a randomly selected patient from this group will have a length of stay: 


(a) Greater than 50 days (b) Less than 30 days 
(c) Between 30 and 60 days (d) Greater than 90 days 


If the total cholesterol values for a certain population are approximately normally distributed with a 
mean of 200 mg/100 ml and a standard deviation of 20 mg/100 ml, find the probability that an 
individual picked at random from this population will have a cholesterol value: 


(a) Between 180 and 200 mg/100 ml (b) Greater than 225 mg/100 ml 
(c) Less than 150 mg/100 ml (d) Between 190 and 210 mg/100 ml 


Given a normally distributed population with a mean of 75 and a variance of 625, find: 


(a) P(50 < x < 100) (b) Р(х > 90) 
(c) P(x « 60) (d) Р(х > 85) 
(e) P(30 « x « 110) 


The weights of a certain population of young adult females are approximately normally distributed 
with a mean of 132 pounds and a standard deviation of 15. Find the probability that a subject selected 
at random from this population will weigh: 


(a) More than 155 pounds (b) 100 pounds or less 
(c) Between 105 and 145 pounds 


4.8 SUMMARY 


In this chapter the concepts of probability described in the preceding chapter are further 
developed. The concepts of discrete and continuous random variables and their probability 
distributions are discussed. In particular, two discrete probability distributions, the 
binomial and the Poisson, and one continuous probability distribution, the normal, are 
examined in considerable detail. We have seen how these theoretical distributions allow us 
to make probability statements about certain random variables that are of interest to the 
health professional. 
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SUMMARY OF FORMULAS FOR CHAPTER 4 


Formula 
Number Name Formula 
4.2.1 Mean of a frequency и = У)хр(х) 
distribution 
4.2.2 Variance of a frequency o? = Y (х и)?р(х) 
distribution Or 
c? = Ура) - и? 
4.3.1 Combination of objects n! 
„С, — AL 
x!(n — 1)! 
4.3.2 Binomial distribution function | f(x) = „ Cyp'q" *,x = 0,1,2,... 
4.3.3—4.3.5 Tabled binomial probability P(X = х|п,р > 50) = P(X =n — x|n,1 — p) 
liti 
SUNT P(X € х|п,р > 50) = P(X 2 n — x|n, 1 — p) 
Р(Х > x|n,p > .50) = Р(Х € n — x|n, 1 — p) 
4.4.1 Poisson distribution function e^ 
f(x) => ,x=0,1,2 
4.6.1 Normal distribution function — <x < oo 
f(x) = : eeu оо < u < оо 
Удло o>0 
4.6.2 z-transformation — X-u 
o 
4.6.3 Standard normal distribution 1 n 
: f(z)- е 315, —oo«z«oo 
function Эл 
Symbol Key | * „C, = acombination of nevents taken xat a time 


e — Euler'sconstant — 2.71828... 

f(x) = function of x 

À — the parameter of the Poisson distribution 

n — sample size or the total number of time a process occurs 
p — binomial “success” probability 

p(x) = discrete probability of random variableX 
q = 1 — p = binomial “failure” probability 

7 — pi — constant — 3.14159... 

о = population standard deviation 

о? = population variance 

и = population mean 

x — a quantity of individual value of X 

X — random variable 

z — standard normal transformation 
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REVIEW QUESTIONS AND EXERCISES 
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What is a discrete random variable? Give three examples that are of interest to the health 
professional. 


What is a continuous random variable? Give three examples of interest to the health professional. 
Define the probability distribution of a discrete random variable. 

Define the probability distribution of a continuous random variable. 

What is a cumulative probability distribution? 

What is a Bernoulli trial? 

Describe the binomial distribution. 

Give an example of a random variable that you think follows a binomial distribution. 

Describe the Poisson distribution. 

Give an example of a random variable that you think is distributed according to the Poisson law. 
Describe the normal distribution. 

Describe the standard normal distribution and tell how it is used in statistics. 

Give an example of a random variable that you think is, at least approximately, normally distributed. 


Using the data of your answer to Question 13, demonstrate the use of the standard normal distribution 
in answering probability questions related to the variable selected. 


Kanjanarat et al. (A-12) estimate the rate of preventable adverse drug events (ADEs) in hospitals to 
be 35.2 percent. Preventable ADEs typically result from inappropriate care or medication errors, 
which include errors of commission and errors of omission. Suppose that 10 hospital patients 
experiencing an ADE are chosen at random. Let p — .35, and calculate the probability that: 


(a) Exactly seven of those drug events were preventable 
(b) More than half of those drug events were preventable 
(c) None of those drug events were preventable 


(d) Between three and six inclusive were preventable 


Ina poll conducted by the Pew Research Center in 2003 (A-13), a national sample of adults answered 
the following question, “All in all, do you strongly favor, favor, oppose, or strongly oppose ... 
making it legal for doctors to give terminally ill patients the means to end their lives?" The results 
showed that 43 percent of the sample subjects answered "strongly favor" or "favor" to this question. 
If 12 subjects represented by this sample are chosen at random, calculate the probability that: 


(a) Exactly two of the respondents answer "strongly favor" or "favor" 
(b) No more than two of the respondents answer "strongly favor" or “favor” 


(c) Between five and nine inclusive answer “strongly favor" or “favor” 


In a study by Thomas et al. (A-14) the Poisson distribution was used to model the number of patients 
per month referred to an oncologist. The researchers use a rate of 15.8 patients per month that are 
referred to the oncologist. Use Table C in the Appendix and a rate of 16 patients per month to 
calculate the probability that in a month: 


(a) Exactly 10 patients are referred to an oncologist 
(b) Between five and 15 inclusive are referred to an oncologist 


(c) More than 10 are referred to an oncologist 


18. 


19. 


20. 


21. 


22. 


23. 


24. 
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(d) Less than eight are referred to an oncologist 


(e) Less than 12, but more than eight are referred to an oncologist 


On the average, two students per hour report for treatment to the first-aid room of a large elementary 

school. 

(a) What is the probability that during a given hour three students come to the first-aid room for 
treatment? 

(b) Whatisthe probability that during a given hourtwo orfewer students will reportto the first-aid room? 

(c) What is the probability that during a given hour between three and five students, inclusive, will 
report to the first-aid room? 


A Harris Interactive poll conducted in Fall, 2002 (A-15) via a national telephone survey of adults 
asked, “Do you think adults should be allowed to legally use marijuana for medical purposes if their 
doctor prescribes it, or do you think that marijuana should remain illegal even for medical purposes?" 
The results showed that 80 percent of respondents answered “Yes” to the above question. Assuming 
80 percent of Americans would say “Yes” to the above question, find the probability when eight 
Americans are chosen at random that: 


(a) Six or fewer said “Yes” (b) Seven or more said “Yes” 
(c) All eight said “Yes” (d) Fewer than four said “Yes” 
(e) Between four and seven inclusive said “Yes” 


In a study of the relationship between measles vaccination and Guillain-Barré syndrome (GBS), 
Silveira et al. (A-16) used a Poisson model in the examination of the occurrence of GBS during latent 
periods after vaccinations. They conducted their study in Argentina, Brazil, Chile, and Colombia. 
They found that during the latent period, the rate of GBS was 1.28 cases per day. Using this estimate 
rounded to 1.3, find the probability on a given day of: 


(a) No cases of GBS (b) At least one case of GBS 
(c) Fewer than five cases of GBS 


The IQs of individuals admitted to a state school for the mentally retarded are approximately 
normally distributed with a mean of 60 and a standard deviation of 10. 


(a) Find the proportion of individuals with IQs greater than 75. 

(b) What is the probability that an individual picked at random will have an IQ between 55 and 75? 
(c) Find P(50 < X < 70). 

A nurse supervisor has found that staff nurses, on the average, complete a certain task in 10 minutes. 


If the times required to complete the task are approximately normally distributed with a standard 
deviation of 3 minutes, find: 


(a) The proportion of nurses completing the task in less than 4 minutes 
(b) The proportion of nurses requiring more than 5 minutes to complete the task 


(c) The probability that a nurse who has just been assigned the task will complete it within 3 minutes 


Scores made on a certain aptitude test by nursing students are approximately normally distributed 
with a mean of 500 and a variance of 10,000. 


(a) What proportion of those taking the test score below 200? 


(b) A person is about to take the test. What is the probability that he or she will make a score of 
650 or more? 
(c) What proportion of scores fall between 350 and 675? 


Given a binomial variable with a mean of 20 and a variance of 16, find n and p. 
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25. 


26. 


27. 


28. 
29. 
30. 
31. 
32. 
33. 


34. 


35. 


Suppose a variable X is normally distributed with a standard deviation of 10. Given that .0985 of the 
values of X are greater than 70, what is the mean value of X? 


Given the normally distributed random variable X, find the numerical value of k such that 
P(u — ko € X € u + ko) = 754. 

Given the normally distributed random variable X with mean 100 and standard deviation 15, find the 
numerical value of k such that: 

(a) Р(Х € к) = .0094 

(b) Р(Х > k) = .1093 

(c) P(100 € X < k) = .4778 

(d) P(K < X < k) = 9660, where K' and k are equidistant from ш 


Given the normally distributed random variable X with o = 10 and Р(Х < 40) = .0080, find и. 
Given the normally distributed random variable X with o = 15 and Р(Х < 50) = .9904, find и. 
Given the normally distributed random variable X with o = 5 and P(X > 25) = 0526, find и. 

Given the normally distributed random variable X with и = 25 and Р(Х < 10) = .0778, find о. 
Given the normally distributed random variable X with и = 30 and Р(Х < 50) = .9772, find o. 


Explain why each of the following measurements is or is not the result of a Bernoulli trial: 
(a) The gender of a newborn child 
(b) The classification of a hospital patient's condition as stable, critical, fair, good, or poor 


(c) The weight in grams of a newborn child 


Explain why each of the following measurements is or is not the result of a Bernoulli trial: 
(a) The number of surgical procedures performed in a hospital in a week 
(b) A hospital patient's temperature in degrees Celsius 


(c) A hospital patient's vital signs recorded as normal or not normal 


Explain why each of the following distributions is or is not a probability distribution: 


(a) (b) 
x Р(Х - x) x P(X — x) 
0 0.15 0 0.15 
1 0.25 1 0.20 
2 0.10 2 0.30 
3 0.25 3 0.10 
4 0.30 
© x P(X — x) ш x P(X — x) 
0 0.15 —1 0.15 
1 —0.20 0 0.30 
2 0.30 1 0.20 
3 0.20 2 0.15 
4 0.15 3 0.10 
4 0.10 


REFERENCES 133 


REFERENCES 


1. 


А-3. 


А-4. 


А-5. 


А-6. 


А-7. 


Methodology References 


FRANK А. Haicut, Handbook of the Poisson Distribution, Wiley, New York, 1967. 


Applications References 


Davi» H. Horsen, MEGAN C. МсСимсу, and Joun P. Ногсомв, “Food Security Status of Households in 
Appalachian Ohio with Children in Head Start," Journal of American Dietetic Association, 104 (2004), 
238-241. 

Cuap L. Cross, Bo BERNHARD, ANNE ROTHWEILER, MELANIE MULLIN, and ANNABELLE JANAIRO, Research and 
Evaluation of Problem Gambling: Nevada Annual Report, April 2006-April 2007," Final Grant Report to the 
Nevada Division of Health and Human Services. 

North Carolina State Center for Health Statistics and Howard W. Odum Institute for Research in Social Science at 
the University of North Carolina at Chapel Hill. Birth Data set for 2001 found at www.irss.unc.edu/ncvital/ 
bfd1down.html. All calculations were performed by John Holcomb and do not represent the findings of the 
Center or Institute. 

The University of Massachusetts Poll, Conducted May 29-June 2, 2003. Data provided by Massachusetts Health 
Benchmarks. http://www.healthbenchmarks.org/Poll/June2003Survey.cfm. 

National Center for Health Statistics (2001) Data File Documentation, National Health Interview Survey, CD 
Series 10, No. 16A, National Center for Health Statistics, Hyattsville, Maryland. All calculations are the 
responsibility of John Holcomb and do not reflect efforts by NCHS. 

STEVEN $. COUGHLIN, ROBERT J. UHLER, THOMAS RICHARDS, and KATHERINE M. WILSON, “Breast and Cervical Cancer 
Screening Practices Among Hispanic and Non-Hispanic Women Residing Near the United States-Mexico 
Border, 1999-2000,” Family Community Health, 26 (2003), 130-139. 

J. H. Laake and J. А. RØTTINGEN, “Rocuronium and Anaphylaxis—a Statistical Challenge," Acta Anasthesio- 
logica Scandinavica, 45 (2001), 1196-1203. 

Arun D. SinGH, MAHNAZ NOURI, CAROL L. SHIELDS, JERRY A. SHIELDS, and ANDREW Е. SmITH, “Retinal Capillary 
Hemangioma,” Ophthalmology, 10 (2001), 1907-1911. 

PASCALE TUBERT-BITTER, BERNARD BEGAUD, YOLA MORIDE, ANICET CHASLERIE, and FRANCOISE HARAMBURU, 
“Comparing the Toxicity of Two Drugs in the Framework of Spontaneous Reporting: A Confidence Interval 
Approach," Journal of Clinical Epidemiology, 49 (1996), 121—123. 

B. ELDRIDGE, M. Garza, A. McCoy, К. Wo re, H., and К. GRAHAM, “Uptime Normative Values in Children Aged 8 
to 15 Years," Developmental Medicine and Child Neurology, 45 (2003), 189-193. 

ANN M. DISKIN, PATRIK SPANEL, and Davip Ѕмітн, “Time Variation of Ammonia, Acetone, Isoprene, and Ethanol in 
Breath: A Quantitative SIFT-MS study over 30 days,” Physiological Measurement, 24 (2003), 107-119. 
PENKARN KANJANARAT, ALMUT G. WINTERSTEIN, THOMAS E. JoHNs, RANDY С. Harron, RICARDO GONZALEZ-ROTHI, 
and RICHARD SEGAL, “Nature of Preventable Adverse Drug Events in Hospitals: A Literature Review,” American 
Journal of Health-System Pharmacy, 60 (2003), 1750-1759. 

Pew Research Center survey conducted by Princeton Survey Research Associates, June 24—July 8, 2003. Data 
provided by the Roper Center for Public Opinion Research. www.kaisernetwork.org/health_poll/hpoll_index. 
cfm. 

S. J. Thomas, M. V. WiLLiams, М. С. Burnet, and С. В. BAKER, “How Much Surplus Capacity Is Required to 
Maintain Low Waiting Times?,” Clinical Oncology, 13 (2001), 24-28. 

Time, Cable News Network survey conducted by Harris Associates, October 22-23, 2002. Data provided by the 
Roper Center for Public Opinion Research. www.kaisernetwork.org/health_poll/hpoll_index.cfm. 

CLauDio M. DA SILVEIRA, Davip M. SALISBURY, and Ciro A DE QUADROS, “Measles Vaccination and Guillain-Barré 
Syndrome," The Lancet, 349 (1997), 14-16. 


CHAPTER 5 


SOME IMPORTANT SAMPLING 
DISTRIBUTIONS 


CHAPTER OVERVIEW 


This chapter ties together the foundations of applied statistics: descriptive 
measures, basic probability, and inferential procedures. This chapter also 
includes a discussion of one of the most important theorems in statistics, the 
central limit theorem. Students may find it helpful to revisit this chapter from 
time to time as they study the remaining chapters of the book. 


TOPICS 


5.1 INTRODUCTION 

5.2 SAMPLING DISTRIBUTIONS 

5.3 DISTRIBUTION OF THE SAMPLE MEAN 

5.4 DISTRIBUTION OF THE DIFFERENCE BETWEEN TWO SAMPLE MEANS 

5.5 DISTRIBUTION OF THE SAMPLE PROPORTION 

5.6 DISTRIBUTION OF THE DIFFERENCE BETWEEN TWO SAMPLE PROPORTIONS 
5.7 SUMMARY 


LEARNING OUTCOMES 


After studying this chapter, the student will 

1. be able to construct a sampling distribution of a statistic. 

2. understand how to use a sampling distribution to calculate basic probabilities. 
3. understand the central limit theorem and when to apply it. 
4 


understand the basic concepts of sampling with replacement and without 
replacement. 


5.1 INTRODUCTION 


Before we examine the subject matter of this chapter, let us review the high points of 
what we have covered thus far. Chapter 1 introduces some basic and useful statistical 
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vocabulary and discusses the basic concepts of data collection. In Chapter 2, the 
organization and summarization of data are emphasized. It is here that we encounter 
the concepts of central tendency and dispersion and learn how to compute their 
descriptive measures. In Chapter 3, we are introduced to the fundamental ideas of 
probability, and in Chapter 4 we consider the concept of a probability distribution. These 
concepts are fundamental to an understanding of statistical inference, the topic that 
comprises the major portion of this book. 

This chapter serves as a bridge between the preceding material, which is essentially 
descriptive in nature, and most of the remaining topics, which have been selected from the 
area of statistical inference. 


5.2 SAMPLING DISTRIBUTIONS 


The topic of this chapter is sampling distributions. The importance of a clear understanding 
of sampling distributions cannot be overemphasized, as this concept is the very key to 
understanding statistical inference. Sampling distributions serve two purposes: (1) they 
allow us to answer probability questions about sample statistics, and (2) they provide the 
necessary theory for making statistical inference procedures valid. In this chapter we use 
sampling distributions to answer probability questions about sample statistics. We recall 
from Chapter 2 that a sample statistic is a descriptive measure, such as the mean, median, 
variance, or standard deviation, that is computed from the data of a sample. In the chapters 
that follow, we will see how sampling distributions make statistical inferences valid. 
We begin with the following definition. 


DEFINITION 


The distribution of all possible values that can be assumed by some 
statistic, computed from samples of the same size randomly drawn from 
the same population, is called the sampling distribution of that statistic. 


Sampling Distributions: Construction Sampling distributions may be 
constructed empirically when sampling from a discrete, finite population. To construct a 
sampling distribution we proceed as follows: 


1. From a finite population of size N, randomly draw all possible samples of size n. 
2. Compute the statistic of interest for each sample. 


3. List in one column the different distinct observed values of the statistic, and in 
another column list the corresponding frequency of occurrence of each distinct 
Observed value of the statistic. 


The actual construction of a sampling distribution is a formidable undertaking if the 
population is of any appreciable size and is an impossible task if the population is infinite. 
In such cases, sampling distributions may be approximated by taking a large number of 
samples of a given size. 


136  cHAPTER5 SOME IMPORTANT SAMPLING DISTRIBUTIONS 


Sampling Distributions: Important Characteristics We usually are 
interested in knowing three things about a given sampling distribution: its mean, its 
variance, and its functional form (how it looks when graphed). 

We can recognize the difficulty of constructing a sampling distribution according to 
the steps given above when the population is large. We also run into a problem when 
considering the construction of a sampling distribution when the population is infinite. The 
best we can do experimentally in this case is to approximate the sampling distribution of a 
statistic. 

Both of these problems may be obviated by means of mathematics. Although the 
procedures involved are not compatible with the mathematical level of this text, 
sampling distributions can be derived mathematically. The interested reader can consult 
one of many mathematical statistics textbooks, for example, Larsen and Marx (1) or 
Rice (2). 

In the sections that follow, some of the more frequently encountered sampling 
distributions are discussed. 


5.3 DISTRIBUTION OF THE SAMPLE MEAN 


An important sampling distribution is the distribution of the sample mean. Let us see how 
we might construct the sampling distribution by following the steps outlined in the previous 
section. 


EXAMPLE 5.3.1 


Suppose we have a population of size N — 5, consisting of the ages of five children who are 
outpatients in a community mental health center. The ages are as follows: 
ху = 6, x5 = 8, хз = 10, x4 = 12, and x5 = 14. The mean, и, of this population is equal 
to $^ xi/N = 10 and the variance is 


Let us compute another measure of dispersion and designate it by capital S as 
follows: 


2 
e а-и)? 49 us 


N-1 4 


We will refer to this quantity again in the next chapter. We wish to construct the sampling 
distribution of the sample mean, x, based on samples of size n — 2 drawn from this 
population. 


Solution: Let us draw all possible samples of size n = 2 from this population. These 
samples, along with their means, are shown in Table 5.3.1. 
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TABLE 5.3.1 All Possible Samples of Size n — 2 from a Population of Size 
М = 5. Samples Above or Below the Principal Diagonal Result When Sampling 15 
Without Replacement. Sample Means Are in Parentheses 


Second Draw 
6 8 10 12 14 
6 6,6 6,8 6, 10 6, 12 6, 14 
(6) (7) (8) (9) (10) 
8 8,6 8,8 8, 10 8, 12 8, 14 
(7) (8) (9) (10) (11) 
First Draw 10 10, 6 10, 8 10, 10 10, 12 10, 14 
(8) (9) (10) (11) (12) 
12 12,6 12,8 12,10 12, 12 12, 14 
(9) (10) (11) (12) (13) 
14 14,6 14,8 14, 10 14, 12 14, 14 
(10) (11) (12) (13) (14) 


TABLE 5.3.2 Sampling 
Distribution of x Computed 
from Samples in Table 5.3.1 


Relative 

x Frequency Frequency 
6 1 1/25 
7 2 2/25 
8 3 3/25 
9 4 4/25 
10 5 5/25 
11 4 4/25 
12 3 3/25 
13 2 2/25 
14 1 1/25 
Total 25 25/25 


We see in this example that, when sampling is with replacement, there 
are 25 possible samples. In general, when sampling is with replacement, the 
number of possible samples is equal to N". 

We may construct the sampling distribution of x by listing the different 
values of x in one column and their frequency of occurrence in another, as in 
Table 5.3.2. и 


We see that the data of Table 5.3.2 satisfy the requirements for а probability 
distribution. The individual probabilities are all greater than 0, and their sum is equal 
to 1. 
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Freq (x) 


no о ь т Oo 


6 8 10 12 14 
Distribution of population 


Freq (х) 


no Y ь т Oo 


О a 


6 7 8 9 10 11 12 13 14 x 
Sampling distribution of x 
FIGURE 5.3.1 Distribution of population and sampling distribution of x. 


It was stated earlier that we are usually interested in the functional form of a sampling 
distribution, its mean, and its variance. We now consider these characteristics for the 
sampling distribution of the sample mean, x. 


Sampling Distribution of x: Functional Form Let us look at the 
distribution of x plotted as a histogram, along with the distribution of the population, 
both of which are shown in Figure 5.3.1. We note the radical difference in appearance 
between the histogram of the population and the histogram of the sampling distribution of 
x. Whereas the former is uniformly distributed, the latter gradually rises to a peak and then 
drops off with perfect symmetry. 


Sampling Distribution of x: Mean Now let us compute the mean, which we 
will call их, of our sampling distribution. To do this we add the 25 sample means and divide 
by 25. Thus, 


Ух 6+74+74+84---4+14 250 


H= N 25 ~ 25 


We note with interest that the mean of the sampling distribution of x has the same 
value as the mean of the original population. 
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Sampling Distribution of x: Variance Finally, we may compute the 
variance of x, which we call o? as follows: 


25 3. MES — н)” 


N” 
(6310) + (7 — 10)? + (710) +--+ (14 -— 10)? 
E T 
= —=4 


25 


We note that the variance of the sampling distribution is not equal to the population 
variance. It is of interest to observe, however, that the variance of the sampling distribution 
is equal to the population variance divided by the size of the sample used to obtain the 
sampling distribution. That is, 


The square root of the variance of the sampling distribution, y/o 2 = af y/n is called the 
standard error of the mean or, simply, the standard error. 

These results are not coincidences but are examples of the characteristics of sampling 
distributions in general, when sampling is with replacement or when sampling is from an 
infinite population. To generalize, we distinguish between two situations: sampling from a 
normally distributed population and sampling from a nonnormally distributed population. 


Sampling Distribution of x: Sampling from Normally Distrib- 
uted Populations When sampling is from a normally distributed population, the 
distribution of the sample mean will possess the following properties: 


1. The distribution of x will be normal. 


2. The mean, uy, of the distribution of x will be equal to the mean of the population from 
which the samples were drawn. 


3. The variance, o? of the distribution of x will be equal to the variance of the population 
divided by the sample size. 


Sampling from Nonnormally Distributed Populations  Forthe case 
where sampling is from a nonnormally distributed population, we refer to an important 
mathematical theorem known as the central limit theorem. The importance of this theorem 
in statistical inference may be summarized in the following statement. 


The Central Limit Theorem 


Given a population of any nonnormal functional form with a mean y and finite variance 
o°, the sampling distribution of X, computed from samples of size n from this population, 
will have mean и and variance o? /n and will be approximately normally distributed 
when the sample size is large. 
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A mathematical formulation of the central limit theorem is that the distribution of 


х= Ш 


о/уп 


approaches a normal distribution with mean 0 and variance 1 as n — со. Note that the 
central limit theorem allows us to sample from nonnormally distributed populations with a 
guarantee of approximately the same results as would be obtained if the populations were 
normally distributed provided that we take a large sample. 

The importance of this will become evident later when we learn that a normally 
distributed sampling distribution is a powerful tool in statistical inference. In the case of the 
sample mean, we are assured of at least an approximately normally distributed sampling 
distribution under three conditions: (1) when sampling is from a normally distributed 
population; (2) when sampling is from a nonnormally distributed population and our 
sample is large; and (3) when sampling is from a population whose functional form is 
unknown to us as long as our sample size is large. 

The logical question that arises at this point is, How large does the sample have to be 
in order for the central limit theorem to apply? There is no one answer, since the size of the 
sample needed depends on the extent of nonnormality present in the population. One rule 
of thumb states that, in most practical situations, a sample of size 30 is satisfactory. In 
general, the approximation to normality of the sampling distribution of x becomes better 
and better as the sample size increases. 


Sampling Without Replacement The foregoing results have been given on 
the assumption that sampling is either with replacement or that the samples are drawn from 
infinite populations. In general, we do not sample with replacement, and in most practical 
situations it is necessary to sample from a finite population; hence, we need to become 
familiar with the behavior of the sampling distribution of the sample mean under 
these conditions. Before making any general statements, let us again look at the data 
in Table 5.3.1. The sample means that result when sampling is without replacement are 
those above the principal diagonal, which are the same as those below the principal 
diagonal, if we ignore the order in which the observations were drawn. We see that there are 
10 possible samples. In general, when drawing samples of size n from a finite population of 
size N without replacement, and ignoring the order in which the sample values are drawn, 
the number of possible samples is given by the combination of N things taken n at a time. In 
our present example we have 


м 51 _ 5.4.3! 


з= Мн 208! 23! 


= 10 possible samples. 


The mean of the 10 sample means is 


o Ðu 74+8494---+13 100 
m 10 10 .— 


Их 


We see that once again the mean of the sampling distribution is equal to the population 
mean. 
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The variance of this sampling distribution is found to be 


= 2 
gi © i- ия) = ЗО 


* NCn 10 


and we note that this time the variance of the sampling distribution is not equal to the 
population variance divided by the sample size, since o2 = 3 Æ 8/2 = 4. There is, 
however, an interesting relationship that we discover by multiplying o?/n by 
(N — n)/(N — 1). That is, 


c) N-n 8 5-2 


O V 


This result tells us that if we multiply the variance of the sampling distribution that would 
be obtained if sampling were with replacement, by the factor (N — n)/(N — 1), we obtain 
the value of the variance of the sampling distribution that results when sampling is without 
replacement. We may generalize these results with the following statement. 


When sampling is without replacement from a finite population, the sampling distribu- 
tion of x will have mean and variance 


If the sample size is large, the central limit theorem applies and the sampling 
distribution of x will be approximately normally distributed. 


The Finite Population Correction The factor (№ — n)/(N — 1) is called the 
finite population correction and can be ignored when the sample size is small in 
comparison with the population size. When the population is much larger than the sample, 
the difference between o? /n and (o?/n)((N — n)/(N — 1)] will be negligible. Imagine a 
population of size 10,000 and a sample from this population of size 25; the finite population 
correction would be equal to (10, 000 — 25) /(9999) = .9976. To multiply o? /n by .9976 is 
almost equivalent to multiplying it by 1. Most practicing statisticians do not use the finite 
population correction unless the sample is more than 5 percent of the size of the population. 
That is, the finite population correction is usually ignored when n/N < .05. 


The Sampling Distribution of x: A Summary Let us summarize the 
characteristics of the sampling distribution of x under two conditions. 


1. Sampling is from a normally distributed population with a known population 
variance: 


(a) и: = и 
(b) oz =0/yn 


(c) The sampling distribution of x is normal. 
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2. Sampling is from a nonnormally distributed population with a known population variance: 


(а) и: = ш 
(b) 9x =0/yn, when п/М « .05 


М — 
ох =(0/ym y [тг otherwise 


(c) The sampling distribution of x is approximately normal. 


Applications As we will see in succeeding chapters, knowledge and understanding 
of sampling distributions will be necessary for understanding the concepts of statistical 
inference. The simplest application of our knowledge of the sampling distribution of the 
sample mean is in computing the probability of obtaining a sample with a mean of some 
specified magnitude. Let us illustrate with some examples. 


EXAMPLE 5.3.2 


Suppose it is known that in a certain large human population cranial length is approxi- 
mately normally distributed with a mean of 185.6 mm and a standard deviation of 12.7 mm. 
What is the probability that a random sample of size 10 from this population will have a 
mean greater than 190? 


Solution: We know that the single sample under consideration is one of all possible 
samples of size 10 that can be drawn from the population, so that the mean 
that it yields is one of the x's constituting the sampling distribution of x that, 
theoretically, could be derived from this population. 

When we say that the population is approximately normally distrib- 
uted, we assume that the sampling distribution of x will be, for all practical 
purposes, normally distributed. We also know that the mean and standard 
deviation of the sampling distribution are equal to 185.6 and 


\/ (12.7) /10 = 12.7/4/10 = 4.0161, respectively. We assume that the pop- 


ulation is large relative to the sample so that the finite population correction 
can be ignored. 

We learn in Chapter 4 that whenever we have a random variable that is 
normally distributed, we may very easily transform it to the standard normal 
distribution. Our random variable now is x, the mean of its distribution is их, 
and its standard deviation is ох =0/yn. By appropriately modifying the 
formula given previously, we arrive at the following formula for transforming 
the normal distribution of x to the standard normal distribution: 


X— Hs 
= 5.3.1 
“T ofyn € 


The probability that answers our question is represented by the area to the right of x — 190 
under the curve of the sampling distribution. This area is equal to the area to the right of 


| 190—1856 _ 44 


TOIT аю 4 
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т = 12.7тт 


. 
и = 185.6mm * 


(а) 


e 
bs = 185.6 190 
(b) 


хі 


0 1.10 z 
(с) 
FIGURE 5.3.2 Population distribution, sampling distribution, and standard normal 


distribution, Example 5.3.2: (a) population distribution; (b) sampling distribution of x for 
samples of size 10; (c) standard normal distribution. 


By consulting the standard normal table, we find that the area to the right of 1.10 is .1357; 
hence, we say that the probability is .1357 that a sample of size 10 will have a mean greater 
than 190. 

Figure 5.3.2 shows the relationship between the original population, the sampling 
distribution of x and the standard normal distribution. 


EXAMPLE 5.3.3 


If the mean and standard deviation of serum iron values for healthy men are 120 and 
15 micrograms per 100 ml, respectively, what is the probability that a random sample of 
50 normal men will yield a mean between 115 and 125 micrograms per 100 ml? 


Solution: The functional form of the population of serum iron values is not specified, 
but since we have a sample size greater than 30, we make use of the central 
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limit theorem and transform the resulting approximately normal sampling 
distribution of x (which has a mean of 120 and a standard deviation of 
15/4/50 — 2.1213) to the standard normal. The probability we seek is 


115 — 120 125 — 120 
P(115 < x 125) = r( 50 о ) 
P(—2.36 < z < 2.36) 
= .9909 — .0091 
.9818 B 


EXERCISES 


5.3.1 


5.3.2 


5.3.3 


5.3.4 


5.3.5 


The National Health and Nutrition Examination Survey of 1988-1994 (NHANES III, А-1) estimated 
the mean serum cholesterol level for U.S. females aged 20—74 years to be 204 mg/dl. The estimate of 
the standard deviation was approximately 44. Using these estimates as the mean џи and standard 
deviation o for the U.S. population, consider the sampling distribution of the sample mean based on 
samples of size 50 drawn from women in this age group. What is the mean of the sampling 
distribution? The standard error? 


The study cited in Exercise 5.3.1 reported an estimated mean serum cholesterol level of 183 for 
women aged 20-29 years. The estimated standard deviation was approximately 37. Use these 
estimates as the mean yu and standard deviation ø for the U.S. population. If a simple random sample 
of size 60 is drawn from this population, find the probability that the sample mean serum cholesterol 
level will be: 


(a) Between 170 and 195 (b) Below 175 
(c) Greater than 190 


If the uric acid values in normal adult males are approximately normally distributed with a mean and 
standard deviation of 5.7 and 1 mg percent, respectively, find the probability that a sample of size 9 
will yield a mean: 


(a) Greater than 6 (b) Between 5 and 6 
(c) Less than 5.2 


Wright et al. [A-2] used the 1999-2000 National Health and Nutrition Examination Survey 
(NHANES) to estimate dietary intake of 10 key nutrients. One of those nutrients was calcium 
(mg). They found in all adults 60 years or older a mean daily calcium intake of 721 mg with a 
standard deviation of 454. Using these values for the mean and standard deviation for the U.S. 
population, find the probability that a random sample of size 50 will have a mean: 


(a) Greater than 800 mg (b) Less than 700 mg 
(c) Between 700 and 850 mg 


In the study cited in Exercise 5.3.4, researchers found the mean sodium intake in men and women 
60 years or older to be 2940 mg with a standard deviation of 1476 mg. Use these values for the 
mean and standard deviation of the U.S. population and find the probability that a random sample of 
75 people from the population will have a mean: 


(a) Less than 2450 mg (b) Over 3100 mg 
(c) Between 2500 and 3300 mg (d) Between 2500 and 2900 mg 
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5.3.6 Given a normally distributed population with a mean of 100 and a standard deviation of 20, find the 
following probabilities based on a sample of size 16: 


(а) Р(х > 100) (b) P(x « 110) 
(c) P(96 « x « 108) 


5.3.7 Given и = 50, о = 16, and n = 64, find: 


(а) P(45 < x < 55) (b) Р(х > 53) 
(c) P(x « 47) (d) P(49 < x « 56) 


5.3.8 Suppose a population consists of the following values: 1, 3, 5, 7, 9. Construct the sampling 
distribution of x based on samples of size 2 selected without replacement. Find the mean and 
variance of the sampling distribution. 


5.3.9 Use the data of Example 5.3.1 to construct the sampling distribution of x based on samples of size 3 
selected without replacement. Find the mean and variance of the sampling distribution. 


5.3.10 Use the data cited in Exercise 5.3.1. Imagine we take samples of size 5, 25, 50, 100, and 500 from the 
women in this age group. 
(a) Calculate the standard error for each of these sampling scenarios. 


(b) Discuss how sample size affects the standard error estimates calculated in part (a) and the 
potential implications this may have in statistical practice. 


5.4 DISTRIBUTION OF THE DIFFERENCE 
BETWEEN TWO SAMPLE MEANS 


Frequently the interest in an investigation is focused on two populations. Specifically, an 
investigator may wish to know something about the difference between two population 
means. In one investigation, for example, a researcher may wish to know if it is reasonable 
to conclude that two population means are different. In another situation, the researcher 
may desire knowledge about the magnitude of the difference between two population 
means. A medical research team, for example, may want to know whether or not the mean 
serum cholesterol level is higher in a population of sedentary office workers than in a 
population of laborers. If the researchers are able to conclude that the population means are 
different, they may wish to know by how much they differ. A knowledge of the sampling 
distribution of the difference between two means is useful in investigations of this type. 


Sampling from Normally Distributed Populations The following 
example illustrates the construction of and the characteristics of the sampling distribution 
of the difference between sample means when sampling is from two normally distributed 
populations. 


EXAMPLE 5.4.1 


Suppose we have two populations of individuals—one population (population 1) has 
experienced some condition thought to be associated with mental retardation, and the other 
population (population 2) has not experienced the condition. The distribution of 
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intelligence scores in each of the two populations is believed to be approximately normally 
distributed with a standard deviation of 20. 

Suppose, further, that we take a sample of 15 individuals from each population and 
compute for each sample the mean intelligence score with the following results: x, = 92 
and х = 105. If there is no difference between the two populations, with respect to their 
true mean intelligence scores, what is the probability of observing a difference this large or 
larger (X1 — х2) between sample means? 


Solution: To answer this question we need to know the nature of the sampling 
distribution of the relevant statistic, the difference between two sample 
means, Хі — Xo. Notice that we seek a probability associated with the 
difference between two sample means rather than a single mean. E 


Sampling Distribution of x4 — x2: Construction Although, in prac- 
tice, we would not attempt to construct the desired sampling distribution, we can 
conceptualize the manner in which it could be done when sampling is from finite 
populations. We would begin by selecting from population 1 all possible samples of 
size 15 and computing the mean for each sample. We know that there would be y, C,, such 
samples where N; is the population size and nı = 15. Similarly, we would select all 
possible samples of size 15 from population 2 and compute the mean for each of these 
samples. We would then take all possible pairs of sample means, one from population 1 and 
one from population 2, and take the difference. Table 5.4.1 shows the results of following 
this procedure. Note that the 1’s and 2’s in the last line of this table are not exponents, but 
indicators of population 1 and 2, respectively. 


Sampling Distribution of x4 — x2: Characteristics It is the distribu- 
tion of the differences between sample means that we seek. If we plotted the sample 
differences against their frequency of occurrence, we would obtain a normal distribution 
with a mean equal to и; — м2, the difference between the two population means, and a 
variance equal to (o1 / пі) + (03 / пә). That 15, the standard error of the difference between 


TABLE 5.4.1 Working Table for Constructing the Distribution of the Difference 
Between Two Sample Means 


Samples Samples Sample Sample All Possible 
from from Means Means Differences 
Population 1 Population 2 Population 1 Population 2 Between Means 
пи m2 Хп X12 X11 — X12 

n2 n22 Xn X22 X11 — X22 

nai n32 X31 X32 X11 — X32 


пм, Съ, 1 пм, Съ,2 Хм Си, 1 Хм, Сп, 2 Хм, Cn, 1 - Хм, Сп, 2 
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Ui ox c ue Xj 7 Xo 


FIGURE 5.4.1 Graph ofthe sampling distribution of x1 — x? when there is no difference 
between population means, Example 5.4.1. 


sample means would be equal to V (oi /т) + (о5 /n2). It should be noted that these 


properties convey two important points. First, the means of two distributions can be 
subtracted from one another, or summed together, using standard arithmetic operations. 
Second, since the overall variance of the sampling distribution will be affected by both 
contributing distributions, the variances will always be summed even if we are interested in 
the difference of the means. This last fact assumes that the two distributions are 
independent of one another. 

For our present example we would have a normal distribution with a mean ої 0 
(if there is no difference between the two population means) and a variance of 
((20)2/15) + [(20)? /15] = 53.3333. The graph of the sampling distribution is shown in 
Figure 5.4.1. 


Converting toz We know that the normal distribution described in Example 5.4.1 
can be transformed to the standard normal distribution by means of a modification of a 
previously learned formula. The new formula is as follows: 


2 (5.4.1) 
o? 2 
clo 92 
п n»? 


The area under the curve of x; — x» corresponding to the probability we seek is the 
area to the left of x; — xo = 92 — 105 = —13. The z value corresponding to —13, assuming 
that there is no difference between population means, is 


та -13-0 -13 —13 it 
(20) (20) 533 7.3 
——— + — 
15 15 


By consulting Table D, we find that the area under the standard normal curve to the left of 
—1.78 is equal to .0375. In answer to our original question, we say that if there is no 
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difference between population means, the probability of obtaining a difference between 
sample means as large as or larger than 13 is .0375. 


Sampling from Normal Populations The procedure we have just followed 
is valid even when the sample sizes, n, and m, are different and when the population 
variances, о? апа az have different values. The theoretical results on which this procedure 
1s based may be summarized as follows. 


Given two normally distributed populations with means u; and u, and variances ої 


and 07, respectively, the sampling distribution of the difference, X, — X», between the 
means of independent samples of size ny and п» drawn from these populations is 


normally distributed with mean шу — [Ly and variance (0?/n1) + (o/nz). 


Sampling from Nonnormal Populations Many times a researcher is 
faced with one or the other of the following problems: the necessity of (1) sampling from 
nonnormally distributed populations, or (2) sampling from populations whose functional 
forms are not known. A solution to these problems is to take large samples, since when the 
sample sizes are large the central limit theorem applies and the distribution of the 
difference between two sample means is at least approximately normally distributed 
with a mean equal to шу — и» and a variance of (oi / n) + (оз / m). To find probabilities 
associated with specific values of the statistic, then, our procedure would be the same as 
that given when sampling is from normally distributed populations. 


EXAMPLE 5.4.2 


Suppose it has been established that for a certain type of client the average length of a home 
visit by a public health nurse is 45 minutes with a standard deviation of 15 minutes, and that 
for a second type of client the average home visit is 30 minutes long with a standard 
deviation of 20 minutes. If a nurse randomly visits 35 clients from the first and 40 from the 
second population, what is the probability that the average length of home visit will differ 
between the two groups by 20 or more minutes? 


Solution: No mention is made of the functional form of the two populations, so let us 
assume that this characteristic is unknown, or that the populations are not 
normally distributed. Since the sample sizes are large (greater than 30) in 
both cases, we draw on the results of the central limit theorem to answer the 
question posed. We know that the difference between sample means is at 
least approximately normally distributed with the following mean and 
variance: 


Шз = Ш — йо = 45 — 30 = 15 


— 16.4286 


> 491,08 (5) Q0) 
п п» 35 40 
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.1093 


. 
0 1.23 2 


FIGURE 5.4.2 Sampling distribution of x; - x2 and the corresponding standard normal 
distribution, home visit example. 


The area under the curve of x, — x» that we seek is that area to the right of 20. 
The corresponding value of z in the standard normal is 


02 o V16.4286 4.0532 | 
m m 


In Table D we find that the area to the right of z= 1.23 is 
1 — .8907 = .1093. We say, then, that the probability of the nurse’s random 
visits resulting in a difference between the two means as great as or greater 
than 20 minutes is .1093. The curve of x, — x2 and the corresponding 
standard normal curve are shown in Figure 5.4.2. и 


EXERCISES 
5.4.1 The study cited in Exercises 5.3.1 and 5.3.2 gives the following data on serum cholesterol levels in 
U.S. females: 
Population Age Mean Standard Deviation 
A 20-29 183 37:2 


B 30-39 189 34.7 
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Use these estimates as the mean u and standard deviation o for the respective U.S. populations. 
Suppose we select a simple random sample of size 50 independently from each population. What is 
the probability that the difference between sample means xg — X4 will be more than 8? 


5.4.2. In the study cited in Exercises 5.3.4 and 5.3.5, the calcium levels in men and women ages 60 years or 
older are summarized in the following table: 


Mean Standard Deviation 
Men 79] 482 
Women 660 414 


Use these estimates as the mean u and standard deviation o for the U.S. populations for these age 
groups. If we take a random sample of 40 men and 35 women, what is the probability of obtaining a 
difference between sample means of 100 mg or more? 


5.4.3 Given two normally distributed populations with equal means and variances of а? = 100 апа 
оз = 80, what is the probability that samples of size nı = 25 and m = 16 will yield a value of x1 — X; 
greater than or equal to 8? 


5.4.4 Given two normally distributed populations with equal means and variances of а? = 240 апа 
о? = 350, what is the probability that samples of size n; = 40 and п» = 35 will yield a value of 
X; — № as large as or larger than 12? 


5.4.5 For a population of 17-year-old boys and 17-year-old girls, the means and standard deviations, 
respectively, of their subscapular skinfold thickness values are as follows: boys, 9.7 and 6.0; girls, 
15.6 and 9.5. Simple random samples of 40 boys and 35 girls are selected from the populations. What 
is the probability that the difference between sample means х,и — Xboys Will be greater than 10? 


5.5 DISTRIBUTION OF THE 
SAMPLE PROPORTION 


In the previous sections we have dealt with the sampling distributions of statistics 
computed from measured variables. We are frequently interested, however, in the sampling 
distribution of a statistic, such as a sample proportion, that results from counts or frequency 
data. 


EXAMPLE 5.5.1 


Results [A-3] from the 2009-2010 National Health and Nutrition Examination Survey 
(NHANES), show that 35.7 percent of U.S. adults aged 20 and over are obese (obese as 
defined with body mass index greater than or equal to 30.0). We designate this population 
proportion as p — .357. If we randomly select 150 individuals from this population, what is 
the probability that the proportion in the sample who are obese will be as great as .40? 


Solution: To answer this question, we need to know the properties of the sampling 
distribution of the sample proportion. We will designate the sample propor- 
tion by the symbol р. 
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You will recognize the similarity between this example and those 
presented in Section 4.3, which dealt with the binomial distribution. The 
variable obesity is a dichotomous variable, since an individual can be classi- 
fied into one or the other of two mutually exclusive categories: obese or not 
obese. In Section 4.3, we were given similar information and were asked to 
find the number with the characteristic of interest, whereas here we are 
seeking the proportion in the sample possessing the characteristic of interest. 
We could with a sufficiently large table of binomial probabilities, such as 
Table B, determine the probability associated with the number corresponding 
to the proportion of interest. As we will see, this will not be necessary, since 
there is available an alternative procedure, when sample sizes are large, that is 
generally more convenient. [| 


Sampling Distribution of p: Construction The sampling distribution of 
a sample proportion would be constructed experimentally in exactly the same manner as 
was suggested in the case of the arithmetic mean and the difference between two means. 
From the population, which we assume to be finite, we would take all possible samples 
of a given size and for each sample compute the sample proportion, p. We would then 
prepare a frequency distribution of p by listing the different distinct values of p along 
with their frequencies of occurrence. This frequency distribution (as well as the 
corresponding relative frequency distribution) would constitute the sampling distribu- 
tion of p. 


Sampling Distribution of p: Characteristics When the sample size 
is large, the distribution of sample proportions is approximately normally distributed 
by virtue of the central limit theorem. The mean of the distribution, Mp» that is, the 
average of all the possible sample proportions, will be equal to the true population 
proportion, p, and the variance of the distribution, o$, will be equal to p(1 — p)/n or 
pq/n, where q = 1 — p. To answer probability questions about p, then, we use the 
following formula: 


z=- ЕБ (5.5.1) 


The question that now arises is, How large does the sample size have to be for the use 
of the normal approximation to be valid? A widely used criterion is that both np and 
n(1 — p) must be greater than 5, and we will abide by that rule in this text. 

We are now in a position to answer the question regarding obesity in the sample of 
150 individuals from a population in which 35.7 percent are obese. Since both np and 
n(1 — p) are greater than 5(150 x .357 = 53.6 and 150 x .643 = 96.5), we can say that, in 
this case, р is approximately normally distributed with a mean 1,, = р = .357 and 
o? = p(1— p)/n = (.357)(.643)/150 = .00153. The probability we seek is the area under 


D 
the curve of р that is to the right of .40. This area is equal to the area under the standard 
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normal curve to the right of 


|| p-p 40-357 _ 
pa» М.00153 


п 


The transformation to the standard normal distribution has been accomplished in 
the usual manner. The value of z is found by dividing the difference between a value of a 
statistic and its mean by the standard error of the statistic. Using Table D we find that the 
area to the right of z = 1.101s 1 — .8643 — .1357. We may say, then, that the probability 
of observing р > .40 in a random sample of size n = 150 from a population in which 
р = .357 is .1357. 


Correction for Continuity The normal approximation may be improved by 
using the correction for continuity, a device that makes an adjustment for the fact that a 
discrete distribution is being approximated by a continuous distribution. Suppose we let 
x — np, the number in the sample with the characteristic of interest when the proportion is 
Р. To apply the correction for continuity, we compute 


Euer 
Ze = “~., forx«np (5.5.2) 
v pq/n 
or 
х-.5 
zs (5.5.3) 
Ze = forx > np zs 


vpq/n ` 


where q — 1 — p. The correction for continuity will not make a great deal of difference 
when 7 is large. In the above example np — 150(.4) — 60, and 


60 — .5 
ел — 357 
150 i 


V(357)(.643)/150 — і 


4с = 


and P(p > 40) = 1 — .8461 = .1539, a result not greatly different from that obtained 
without the correction for continuity. This adjustment is not often done by hand, since most 
statistical computer programs automatically apply the appropriate continuity correction 
when necessary. 


EXAMPLE 5.5.2 


Blanche Mikhail [A-4] studied the use of prenatal care among low-income African- 
American women. She found that only 51 percent of these women had adequate prenatal 
care. Let us assume that for a population of similar low-income African-American women, 
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51 percent had adequate prenatal care. If 200 women from this population are drawn at 
random, what is the probability that less than 45 percent will have received adequate 
prenatal care? 


Solution: We can assume that the sampling distribution of p is approximately normally 
distributed with up = .51 and 0; — (.51)(.49)/200 — .00125. We compute 


NM 
~ 4.00125 | 0353 | 


The area to the left of - 1.70 under the standard normal curve is .0446. 
Therefore, P(p € .45) = P(z € —1.70) — .0446. L| 


1.70 


EXERCISES 


5.5.1 


5.52 


5.5.3 


5.5.4 


5.5.5 


5.5.6 


Smith et al. [A-5] performed a retrospective analysis of data on 782 eligible patients admitted with 
myocardial infarction to a 46-bed cardiac service facility. Of these patients, 248 (32 percent) reported 
a past myocardial infarction. Use .32 as the population proportion. Suppose 50 subjects are chosen at 
random from the population. What is the probability that over 40 percent would report previous 
myocardial infarctions? 


In the study cited in Exercise 5.5.1, 13 percent of the patients in the study reported previous episodes 
of stroke or transient ischemic attack. Use 13 percent as the estimate of the prevalence of stroke or 
transient ischemic attack within the population. If 70 subjects are chosen at random from the 
population, what is the probability that 10 percent or less would report an incidence of stroke or 
transient ischemic attack? 


In the 1999-2000 NHANES report, researchers estimated that 64 percent of U.S. adults ages 20—74 
were overweight or obese (overweight: BMI 25-29, obese: BMI 30 or greater). Use this estimate 
as the population proportion for U.S. adults ages 20-74. If 125 subjects are selected at random 
from the population, what is the probability that 70 percent or more would be found to be 
overweight or obese? 


Gallagher et al. [A-6] reported on a study to identify factors that influence women's attendance 
at cardiac rehabilitation programs. They found that by 12 weeks post-discharge, only 64 
percent of eligible women attended such programs. Using 64 percent as an estimate of the 
attendance percentage of all eligible women, find the probability that in a sample of 45 women 
selected at random from the population of eligible women less than 50 percent would attend 
programs. 


Given a population in which p — .6 and a random sample from this population of size 100, find: 


(a) P(p > .65) (b) P(p < .58) 
(c) P(.56 < p < .63) 


It is known that 35 percent of the members of a certain population suffer from one or more chronic 
diseases. What is the probability that in a sample of 200 subjects drawn at random from this 
population 80 or more will have at least one chronic disease? 
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5.6 DISTRIBUTION OF THE DIFFERENCE 
BETWEEN TWO SAMPLE PROPORTIONS 


Often there are two population proportions in which we are interested and we desire to 
assess the probability associated with a difference in proportions computed from samples 
drawn from each of these populations. The relevant sampling distribution is the distribution 
of the difference between the two sample proportions. 


Sampling Distribution of p, — р»: Characteristics The character- 
istics of this sampling distribution may be summarized as follows: 


If independent random samples of size n, and n5 are drawn from two populations 
of dichotomous variables where the proportions of observations with the character- 
istic of interest in the two populations are p, and p,, respectively, the distribution 
of the difference between sample proportions, p, - р», is approximately normal 
with mean 


Mp =p, = Ру — P2 
and variance 


2 _р\(1—ру) р»(1—р») 
Pi-P2 — + 
т n2 


when n, and m are large. 


We consider п; and п» sufficiently large when nip, пәр», ni(1 — рі), and n2(1 — р») 
are all greater than 5. 


Sampling Distribution of р; - р»: Construction To physically con- 
struct the sampling distribution of the difference between two sample proportions, we 
would proceed in the manner described in Section 5.4 for constructing the sampling 
distribution of the difference between two means. 

Given two sufficiently small populations, one would draw, from population 1, all 
possible simple random samples of size n; and compute, from each set of sample data, the 
sample proportion ру. From population 2, one would draw independently all possible 
simple random samples of size n; and compute, for each set of sample data, the sample 
proportion p,. One would compute the differences between all possible pairs of sample 
proportions, where one number of each pair was a value of p, and the other a value of р». 
The sampling distribution of the difference between sample proportions, then, would 
consist of all such distinct differences, accompanied by their frequencies (or relative 
frequencies) of occurrence. For large finite or infinite populations, one could approximate 
the sampling distribution of the difference between sample proportions by drawing a large 
number of independent simple random samples and proceeding in the manner just 
described. 
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To answer probability questions about the difference between two sample propor- 
tions, then, we use the following formula: 
z = i - Ро) - (рі - ра) (5.6.1) 
ү" — pi) | P2(1 - ра) 


+ 
n, п, 


EXAMPLE 5.6.1 


The 1999 National Health Interview Survey, released in 2003 [A-7], reported that 
28 percent of the subjects self-identifying as white said they had experienced lower 
back pain during the three months prior to the survey. Among subjects of Hispanic origin, 
2] percent reported lower back pain. Let us assume that .28 and .21 are the proportions for 
the respective races reporting lower back pain in the United States. What is the probability 
that independent random samples of size 100 drawn from each of the populations will yield 
a value of p, — ро as large as .10? 


Solution: We assume that the sampling distribution of p, — р» is approximately normal 
with mean 


ив, = 28— 21 = .07 


and variance 


2 _ (280072), (2009) 
bib 100 100 
= .003675 


The area corresponding to the probability we seek is the area under the curve 
of p, — p, to the right ої .10. Transforming to the standard normal distribu- 
tion gives 

(Р; - Po) - (рі - P2) _ 10-07 _ 
ура -рі) р. - ро)  v.003675 


ni п2 


z= 


Consulting Table D, we find that the area under the standard normal curve 
that lies to the right of z = .49 is 1 — .6879 = .3121. The probability of 
observing a difference as large as .10 is, then, .3121. и 


EXAMPLE 5.6.2 


In the 1999 National Health Interview Survey [A-7], researchers found that among U.S. 
adults ages 75 or older, 34 percent had lost all their natural teeth and for U.S. adults ages 
65—74, 26 percent had lost all their natural teeth. Assume that these proportions are the 
parameters for the United States in those age groups. If a random sample of 200 adults ages 
65—74 and an independent random sample of 250 adults ages 75 or older are drawn from 
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these populations, find the probability that the difference in percent of total natural teeth 
loss is less than 5 percent between the two populations. 


Solution: We assume that the sampling distribution p, — р» is approximately normal. 
The mean difference in proportions of those losing all their teeth is 


and the variance is 
2 Р\(1—р\) , pY(1 - ро) _ (.34)(.66) , (.26)(.74) 
2 = = = .00186 
Pih E 250 | 200 


The area of interest under the curve of p, — ро is that to the left of .05. The 
corresponding z value is 


_ 05 — (.08) 
00186 


Consulting Table D, we find that the area to the left of z = —.70 is .2420.m 


EXERCISES 


5.6.1 


5.6.2 


5.6.3 


According to the 2000 U.S. Census Bureau [A-8], in 2000, 9.5 percent of children in the state of 
Ohio were not covered by private or government health insurance. In the neighboring state of 
Pennsylvania, 4.9 percent of children were not covered by health insurance. Assume that these 
proportions are parameters for the child populations of the respective states. If a random sample 
of size 100 children is drawn from the Ohio population, and an independent random sample of size 
120 is drawn from the Pennsylvania population, what is the probability that the samples would yield a 
difference, p, — p; of 09 or more? 


In the report cited in Exercise 5.6.1 [A-8], the Census Bureau stated that for Americans in the age 
group 18-24 years, 64.8 percent had private health insurance. In the age group 25-34 years, the 
percentage was 72.1. Assume that these percentages are the population parameters in those age 
groups for the United States. Suppose we select a random sample of 250 Americans from the 18-24 
age group and an independent random sample of 200 Americans from the age group 25-34; find the 
probability that p, — p, is less than 6 percent. 


From the results of a survey conducted by the U.S. Bureau of Labor Statistics [A-9], it was estimated 
that 21 percent of workers employed in the Northeast participated in health care benefits programs 
that included vision care. The percentage in the South was 13 percent. Assume these percentages are 
population parameters for the respective U.S. regions. Suppose we select a simple random sample of 
size 120 northeastern workers and an independent simple random sample of 130 southern workers. 
What is the probability that the difference between sample proportions, p, — ро, will be between .04 
and .20? 
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5.7 SUMMARY 


This chapter is concerned with sampling distributions. The concept of a sampling 
distribution is introduced, and the following important sampling distributions are covered: 
1. The distribution of a single sample mean. 
2. The distribution of the difference between two sample means. 
3. The distribution of a sample proportion. 
4. The distribution of the difference between two sample proportions. 


We emphasize the importance of this material and urge readers to make sure that they 
understand it before proceeding to the next chapter. 


SUMMARY OF FORMULAS FOR CHAPTER 5 


Formula Number | Name Formula 
5.3.1 z-transformation for sample mean Хор 
— б/п 
5.4.1 z-transformation for difference ys (X4 — X3) — (u — ш) 
between two means 2 2 
915705 
pres + EA 
n n 
5.5.1 z-transformation for sample Z Р-Р 
proportion С [p(1— p) 
n 
5.5.2 Continuity correction when x « np x+.5 T 
Ze = n P 
МРА/п 
5.5.3 Continuity correction when x > np Х+.5 + 
Z. = нагі 
МРА/п 
5.6.1 z-transformation for difference p (ĝi = Po) - (рі - ра) 
between two proportions M Р-р). Poll ра) 
| 
" nı | m 
Symbol Key • u; = mean of population i 
є ца = mean of sampling distribution if x 
* n; — sample size for sample i from population 
* р; = proportion for population i 
* p; — proportion for sample i from population i 
* о? = variance for population i 
e X; = mean of sample i from population i 
* z — standard normal random variable 
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REVIEW QUESTIONS AND EXERCISES 


10. 


11. 


12. 


13. 


14. 


15. 


What is a sampling distribution? 
Explain how a sampling distribution may be constructed from a finite population. 


Describe the sampling distribution of the sample mean when sampling is with replacement from a 
normally distributed population. 


Explain the central limit theorem. 


How does the sampling distribution of the sample mean, when sampling is without replacement, 
differ from the sampling distribution obtained when sampling is with replacement? 


Describe the sampling distribution of the difference between two sample means. 
Describe the sampling distribution of the sample proportion when large samples are drawn. 


Describe the sampling distribution of the difference between two sample means when large samples 
are drawn. 


Explain the procedure you would follow in constructing the sampling distribution of the difference 
between sample proportions based on large samples from finite populations. 


Suppose it is known that the response time of healthy subjects to a particular stimulus is a normally 
distributed random variable with a mean of 15 seconds and a variance of 16. What is the 
probability that a random sample of 16 subjects will have a mean response time of 12 seconds or 
more? 


Janssen et al. [A-10] studied Americans ages 60 and over. They estimated the mean body mass index 
of women over age 60 with normal skeletal muscle to be 23.1 with a standard deviation of 3.7. Using 
these values as the population mean and standard deviation for women over age 60 with normal 
skeletal muscle index, find the probability that 45 randomly selected women in this age range with 
normal skeletal muscle index will have a mean BMI greater than 25. 


In the study cited in Review Exercise 11, the researchers reported the mean BMI for men ages 60 
and older with normal skeletal muscle index to be 24.7 with a standard deviation of 3.3. Using 
these values as the population mean and standard deviation, find the probability that 50 
randomly selected men in this age range with normal skeletal muscle index will have a mean 
BMI less than 24. 


Using the information in Review Exercises 11 and 12, find the probability that the difference in mean 
BMI for 45 women and 50 men selected independently and at random from the respective 
populations will exceed 3. 


In the results published by Wright et al. [A-2] based on data from the 1999-2000 NHANES study 
referred to in Exercises 5.4.1 and 5.4.2, investigators reported on their examination of iron levels. The 
mean iron level for women ages 20-39 years was 13.7 mg with an estimated standard deviation of 
8.9 mg. Using these as population values for women ages 20-39, find the probability that a random 
sample of 100 women will have a mean iron level less than 12 mg. 


Refer to Review Exercise 14. The mean iron level for men between the ages of 20 and 39 years is 
17.9 mg with an estimated standard deviation of 10.9 mg. Using 17.9 and 10.9 as population 
parameters, find the probability that a random sample of 120 men will have a mean iron level higher 
than 19 mg. 


16. 


17. 


18. 


19. 


20. 


21. 


22. 


23. 
24. 


25. 


26. 
27. 


28. 
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Using the information in Review Exercises 14 and 15, and assuming independent random samples of 
size 100 and 120 for women and men, respectively, find the probability that the difference in sample 
mean iron levels is greater than 5 mg. 


The results of the 1999 National Health Interview Survey released in 2003 [A-7] showed that among 
U.S. adults ages 60 and older, 19 percent had been told by a doctor or other health care provider that 
they had some form of cancer. If we use this as the percentage for all adults 65 years old and older 
living in the United States, what is the probability that among 65 adults chosen at random more than 
25 percent will have been told by their doctor or some other health care provider that they have 
cancer? 


Refer to Review Exercise 17. The reported cancer rate for women subjects ages 65 and older is 17 
percent. Using this estimate as the true percentage of all females ages 65 and over who have been told 
by a health care provider that they have cancer, find the probability that if 220 women are selected at 
random from the population, more than 20 percent will have been told they have cancer. 


Refer to Review Exercise 17. The cancer rate for men ages 65 and older is 23 percent. Use this 
estimate as the percentage of all men ages 65 and older who have been told by a health care provider 
that they have cancer. Find the probability that among 250 men selected at random that fewer than 
20 percent will have been told they have cancer. 


Use the information in Review Exercises 18 and 19 to find the probability that the difference in the 
cancer percentages between men and women will be less than 5 percent when 220 women and 
250 men aged 65 and older are selected at random. 


How many simple random samples (without replacement) of size 5 can be selected from a population 
of size 10? 


It is estimated by the 1999-2000 NHANES [A-7] that among adults 18 years old or older 53 percent 
have never smoked. Assume the proportion of U.S. adults who have never smoked to be .53. Consider 
the sampling distribution of the sample proportion based on simple random samples of size 110 
drawn from this population. What is the functional form of the sampling distribution? 


Refer to Exercise 22. Compute the mean and variance of the sampling distribution. 


Refer to Exercise 22. What is the probability that a single simple random sample of size 110 drawn 
from this population will yield a sample proportion smaller than .50? 


In a population of subjects who died from lung cancer following exposure to asbestos, it was found 
that the mean number of years elapsing between exposure and death was 25. The standard deviation 
was 7 years. Consider the sampling distribution of sample means based on samples of size 35 drawn 
from this population. What will be the shape of the sampling distribution? 


Refer to Exercise 25. What will be the mean and variance of the sampling distribution? 


Refer to Exercise 25. What is the probability that a single simple random sample of size 35 drawn 
from this population will yield a mean between 22 and 29? 


For each of the following populations of measurements, state whether the sampling distribution of the 
sample mean is normally distributed, approximately normally distributed, or not approximately 
normally distributed when computed from samples of size (A) 10, (B) 50, and (C) 200. 


(a) The logarithm of metabolic ratios. The population is normally distributed. 
(b) Resting vagal tone in healthy adults. The population is normally distributed. 


(c) Insulin action in obese subjects. The population is not normally distributed. 
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29. 


For each of the following sampling situations indicate whether the sampling distribution of the 
sample proportion can be approximated by a normal distribution and explain why or why not. 


(a) p = .50, п= 8 (b) р = .40, n = 30 
(c) р = .10, n = 30 (d) p = .01, n = 1000 
(e) p = .90, n = 100 (f) p = .05, n 150 
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CHAPTER 6 


ESTIMATION 


CHAPTER OVERVIEW 


TOPICS 


This chapter covers estimation, one ofthe two types of statistical inference. As 
discussed in earlier chapters, statistics, such as means and variances, can be 
calculated from samples drawn from populations. These statistics serve as 
estimates of the corresponding population parameters. We expect these 
estimates to differ by some amount from the parameters they estimate. 
This chapter introduces estimation procedures that take these differences 
into account, thereby providing a foundation for statistical inference proce- 
dures discussed in the remaining chapters of the book. 
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CHAPTER 6 ESTIMATION 


LEARNING OUTCOMES 


After studying this chapter, the student will 

1. understand the importance and basic principles of estimation. 

2. be able to calculate interval estimates for a variety of parameters. 

3. be able to interpret a confidence interval from both a practical and a probabilistic 
viewpoint. 

4. understand the basic properties and uses of the t distribution, chi-square distri- 
bution, and F distribution. 


INTRODUCTION 


6.1 


We come now to a consideration of estimation, the first of the two general areas of statistical 
inference. The second general area, hypothesis testing, is examined in the next chapter. 
We learned in Chapter 1 that inferential statistics is defined as follows. 


DEFINITION 


Statistical inference is the procedure by which we reach a conclusion 
about a population on the basis of the information contained in a sample 
drawn from that population. 


The process of estimation entails calculating, from the data of a sample, some 
statistic that is offered as an approximation of the corresponding parameter of the 
population from which the sample was drawn. 

The rationale behind estimation in the health sciences field rests on the assumption 
that workers in this field have an interest in the parameters, such as means and proportions, 
of various populations. If this is the case, there is a good reason why one must rely on 
estimating procedures to obtain information regarding these parameters. Many populations 
of interest, although finite, are so large that a 100 percent examination would be prohibitive 
from the standpoint of cost. 

Suppose the administrator of a large hospital is interested in the mean age of patients 
admitted to his hospital during a given year. He may consider it too expensive to go through 
the records of all patients admitted during that particular year and, consequently, elect to 
examine a sample of the records from which he can compute an estimate of the mean age of 
patients admitted that year. 

A physician in general practice may be interested in knowing what proportion of a 
certain type of individual, treated with a particular drug, suffers undesirable side effects. 
No doubt, her concept of the population consists of all those persons who ever have been or 
ever will be treated with this drug. Deferring a conclusion until the entire population has 
been observed could have an adverse effect on her practice. 

These two examples have implied an interest in estimating, respectively, a population 
mean and a population proportion. Other parameters, the estimation of which we will cover 
in this chapter, are the difference between two means, the difference between two 
proportions, the population variance, and the ratio of two variances. 
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We will find that for each of the parameters we discuss, we can compute two types of 
estimate: a point estimate and an interval estimate. 


DEFINITION 


A point estimate is a single numerical value used to estimate the 
corresponding population parameter. 


DEFINITION 


An interval estimate consists of two numerical values defining a range 
of values that, with a specified degree of confidence, most likely 
includes the parameter being estimated. 


These concepts will be elaborated on in the succeeding sections. 


Choosing an Appropriate Estimator Note that a single computed value has 
been referred to as an estimate. The rule that tells us how to compute this value, or estimate, is 
referred to as an estimator. Estimators are usually presented as formulas. For example, 
¿En 

n 
is an estimator of the population mean, u. The single numerical value that results from 
evaluating this formula is called an estimate of the parameter и. 

In many cases, a parameter may be estimated by more than one estimator. For 
example, we could use the sample median to estimate the population mean. How then do 
we decide which estimator to use for estimating a given parameter? The decision is based 
on an objective measure or set of criteria that reflect some desired property of a particular 
estimator. When measured against these criteria, some estimators are better than others. 
One of these criteria is the property of unbiasedness. 


DEFINITION 


An estimator, say, T, of the parameter 0 is said to be an unbiased estimator 
of 0 if E(T) = 0. 


E(T) is read, “the expected value of 7.” For a finite population, Е(Т) is obtained by 
taking the average value of Т computed from all possible samples of a given size that may 
be drawn from the population. That is, E(T) = ит. For an infinite population, E(T) is 
defined in terms of calculus. 

In the previous chapter we have seen that the sample mean, the sample proportion, 
the difference between two sample means, and the difference between two sample 
proportions are each unbiased estimates of their corresponding parameters. This property 
was implied when the parameters were said to be the means of the respective sampling 
distributions. For example, since the mean of the sampling distribution of x is equal to и, 
we know that x is an unbiased estimator of u. The other criteria of good estimators will not 
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be discussed in this book. The interested reader will find them covered in detail in most 
mathematical statistics texts. 


Sampled Populations and Target Populations The health researcher 
who uses statistical inference procedures must be aware of the difference between two 
kinds of population—the sampled population and the target population. 


DEFINITION 


The sampled population is the population from which one actually draws 
a sample. 


DEFINITION 


The target population is the population about which one wishes to make 
an inference. 


These two populations may or may not be the same. Statistical inference procedures 
allow one to make inferences about sampled populations (provided proper sampling 
methods have been employed). Only when the target population and the sampled 
population are the same is it possible for one to use statistical inference procedures to 
reach conclusions about the target population. If the sampled population and the target 
population are different, the researcher can reach conclusions about the target population 
only on the basis of nonstatistical considerations. 

Suppose, for example, that a researcher wishes to assess the effectiveness of some 
method for treating rheumatoid arthritis. The target population consists of all patients suffering 
from the disease. It is not practical to draw a sample from this population. The researcher may, 
however, select a sample from all rheumatoid arthritis patients seen in some specific clinic. 
These patients constitute the sampled population, and, if proper sampling methods are used, 
inferences about this sampled population may be drawn on the basis of the information in the 
sample. If the researcher wishes to make inferences about all rheumatoid arthritis sufferers, he 
orshe must rely on nonstatistical means to do so. Perhaps the researcher knows that the sampled 
population is similar, with respect to all important characteristics, to the target population. That 
is, the researcher may know that the age, sex, severity of illness, duration of illness, and so on are 
similar in both populations. And on the strength of this knowledge, the researcher may be 
willing to extrapolate his or her findings to the target population. 

In many situations the sampled population and the target population are identical; when 
this is the case, inferences about the target population are straightforward. The researcher, 
however, should be aware that this is not always the case and not fall into the trap of drawing 
unwarranted inferences about a population that is different from the one that is sampled. 


Random and Nonrandom Samples In the examples and exercises of this 
book, we assume that the data available for analysis have come from random samples. The 
strict validity of the statistical procedures discussed depends on this assumption. In many 
instances in real-world applications it is impossible or impractical to use truly random 
samples. In animal experiments, for example, researchers usually use whatever animals are 
available from suppliers or their own breeding stock. If the researchers had to depend on 
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randomly selected material, very little research of this type would be conducted. Again, 
nonstatistical considerations must play a part in the generalization process. Researchers 
may contend that the samples actually used are equivalent to simple random samples, since 
there is no reason to believe that the material actually used is not representative of the 
population about which inferences are desired. 

In many health research projects, samples of convenience, rather than random 
samples, are employed. Researchers may have to rely on volunteer subjects or on readily 
available subjects such as students in their classes. Samples obtained from such sources are 
examples of convenience samples. Again, generalizations must be made on the basis of 
nonstatistical considerations. The consequences of such generalizations, however, may be 
useful or they may range from misleading to disastrous. 

In some situations it is possible to introduce randomization into an experiment even 
though available subjects are not randomly selected from some well-defined population. In 
comparing two treatments, for example, each subject may be randomly assigned to one or 
the other of the treatments. Inferences in such cases apply to the treatments and not the 
subjects, and hence the inferences are valid. 


6.2 CONFIDENCE INTERVAL 
FOR A POPULATION MEAN 


Suppose researchers wish to estimate the mean of some normally distributed population. 
They draw a random sample of size n from the population and compute x, which they use as 
a point estimate of и. Although this estimator of и possesses all the qualities of a good 
estimator, we know that because random sampling inherently involves chance, x cannot be 
expected to be equal to и. 

It would be much more meaningful, therefore, to estimate и by an interval that 
somehow communicates information regarding the probable magnitude of и. 


Sampling Distributions and Estimation To obtain an interval estimate, 
we must draw on our knowledge of sampling distributions. In the present case, because we 
are concerned with the sample mean as an estimator of a population mean, we must recall 
what we know about the sampling distribution of the sample mean. 

In the previous chapter we learned that if sampling is from a normally distributed 
population, the sampling distribution of the sample mean will be normally distributed with 
a mean u, equal to the population mean и, and a variance o? equal to o? /n. We could plot 
the sampling distribution if we only knew where to locate it on the x-axis. From our 
knowledge of normal distributions, in general, we know even more about the distribution of 
x in this case. We know, for example, that regardless of where the distribution of x is 
located, approximately 95 percent of the possible values of x constituting the distribution 
are within two standard deviations of the mean. The two points that are two standard 
deviations from the mean are и — 2o; and u + 20%, so that the interval и + 205 will 
contain approximately 95 percent of the possible values of x. We know that jz and, hence 
их, are unknown, but we may arbitrarily place the sampling distribution of x on the x-axis. 

Since we do not know the value of u, not a great deal is accomplished by the 
expression и + 205. We do, however, have a point estimate of u, which is x. Would it be 
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FIGURE 6.2.1 The 95 percent confidence interval for y. 


useful to construct an interval about this point estimate of u? The answer is yes. Suppose 
we constructed intervals about every possible value of x computed from all possible 
samples of size n from the population of interest. We would have a large number of 
intervals of the form x + 20; with widths all equal to the width of the interval about the 
unknown u. Approximately 95 percent of these intervals would have centers falling within 
the +20; interval about u. Each of the intervals whose centers fall within 20; of и would 
contain u. These concepts are illustrated in Figure 6.2.1, in which we see that x, хз, and x4 
all fall within the interval about u, and, consequently, the 20% intervals about these sample 
means include the value of u. The sample means x2 and xs do not fall within the 20; 
interval about uu, and the 20; intervals about them do not include џ. 


EXAMPLE 6.2.1 


Suppose a researcher, interested in obtaining an estimate of the average level of some 
enzyme in a certain human population, takes a sample of 10 individuals, determines the 
level of the enzyme in each, and computes a sample mean of x — 22. Suppose further it is 
known that the variable of interest is approximately normally distributed with a variance of 
45. We wish to estimate и. 


Solution: An approximate 95 percent confidence interval for u is given by 


x + 205 


145 
22 X24|— 
10 


22 +2(2.1213) 
17.76,26.24 ш 
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Interval Estimate Components Let us examine the composition of the 
interval estimate constructed in Example 6.2.1. It contains in its center the point estimate 
of u. The 2 we recognize as a value from the standard normal distribution that tells us 
within how many standard errors lie approximately 95 percent of the possible values of x. 
This value of z is referred to as the reliability coefficient. The last component, o;, is the 
standard error, or standard deviation of the sampling distribution of x. In general, then, an 
interval estimate may be expressed as follows: 


estimator 4 (reliability coefficient) x (standard error) (6.2.1) 


In particular, when sampling is from a normal distribution with known variance, an 
interval estimate for и may be expressed as 


X c Z(1-0/2)0% (6.2.2) 


where z(1-a/2) is the value of z to the left of which lies 1 — o /2 and to the right of which lies 
0/2 of the area under its curve. 


Interpreting Confidence Intervals How do we interpret the interval given 
by Expression 6.2.2? In the present example, where the reliability coefficient is equal to 2, 
we say that in repeated sampling approximately 95 percent of the intervals constructed by 
Expression 6.2.2 will include the population mean. This interpretation is based on the 
probability of occurrence of different values of x. We may generalize this interpretation if 
we designate the total area under the curve of x that is outside the interval и + 20; as а and 
the area within the interval as 1 — o and give the following probabilistic interpretation of 
Expression 6.2.2. 


Probabilistic Interpretation 


In repeated sampling, from a normally distributed population with a known standard 
deviation, 100(1 — о) percent of all intervals of the form x + z(1-a/2)03 will in the long 
run include the population mean p. 


The quantity 1 — o, in this case .95, is called the confidence coefficient (or confidence 
level), and the interval x -z(1.5/505 is called a confidence interval for и. When 
(1 — а) = .95, the interval is called the 95 percent confidence interval for u. In the 
present example we say that we are 95 percent confident that the population mean is 
between 17.76 and 26.24. This is called the practical interpretation of Expression 6.2.2. In 
general, it may be expressed as follows. 


Practical Interpretation 


When sampling is from a normally distributed population with known standard 
deviation, we are 100(1 — o) percent confident that the single computed interval, 
X + Z(1-a/2)03, contains the population mean p. 


In the example given here we might prefer, rather than 2, the more exact value of z, 
1.96, corresponding to a confidence coefficient of .95. Researchers may use any confidence 
coefficient they wish; the most frequently used values are .90, .95, and .99, which have 
associated reliability factors, respectively, of 1.645, 1.96, and 2.58. 
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Precision The quantity obtained by multiplying the reliability factor by the standard 
error of the mean is called the precision of the estimate. This quantity is also called the 
margin of error. 


EXAMPLE 6.2.2 


A physical therapist wished to estimate, with 99 percent confidence, the mean maximal 
strength of a particular muscle in a certain group of individuals. He is willing to assume that 
strength scores are approximately normally distributed with a variance of 144. A sample of 
15 subjects who participated in the experiment yielded a mean of 84.3. 


Solution: Тһе z value corresponding to a confidence coefficient of .99 is found in Appendix 
Table D to be 2.58. This is our reliability coefficient. The standard error is 
ox = 12/15 = 3.0984. Our 99 percent confidence interval for u, then, is 


84.3 + 2.58(3.0984) 
84.3 + 8.0 
76.3, 92.3 


We say we are 99 percent confident that the population mean is between 
76.3 and 92.3 since, in repeated sampling, 99 percent of all intervals 
that could be constructed in the manner just described would include the 
population mean. Aa 


Situations in which the variable of interest is approximately normally distributed with a 
known variance are quite rare. The purpose of the preceding examples, which assumed that 
these ideal conditions existed, was to establish the theoretical background for constructing 
confidence intervals for population means. In most practical situations either the variables 
are not approximately normally distributed or the population variances are not known or 
both. Example 6.2.3 and Section 6.3 explain the procedures that are available for use in the 
less than ideal, but more common, situations. 


Sampling from Nonnormal Populations As noted, it will not always be 
possible or prudent to assume that the population of interest is normally distributed. Thanks 
to the central limit theorem, this will not deter us if we are able to select a large enough 
sample. We have learned that for large samples, the sampling distribution of x is 
approximately normally distributed regardless of how the parent population is distributed. 


EXAMPLE 6.2.3 


Punctuality of patients in keeping appointments is of interest to a research team. In a study 
of patient flow through the offices of general practitioners, it was found that a sample of 35 
patients was 17.2 minutes late for appointments, on the average. Previous research had 
shown the standard deviation to be about 8 minutes. The population distribution was felt to 
be nonnormal. What is the 90 percent confidence interval for jz, the true mean amount of 
time late for appointments? 
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Solution: Since the sample size is fairly large (greater than 30), and since the population 
standard deviation is known, we draw on the central limit theorem and 
assume the sampling distribution of x to be approximately normally distrib- 
uted. From Appendix Table D we find the reliability coefficient correspond- 
ing to a confidence coefficient of .90 to be about 1.645, if we interpolate. The 
standard error is o; = 8/ У35 = 1.3522, so that our 90 percent confidence 
interval for y is 


17.2 + 1.645(1.3522) 
17.2 + 2.2 
15.0, 19.4 н 


Frequently, when the sample is large enough for the application of the central limit 
theorem, the population variance is unknown. In that case we use the sample variance as a 
replacement for the unknown population variance in the formula for constructing a 
confidence interval for the population mean. 


Computer Analysis When confidence intervals are desired, a great deal of time 
can be saved if one uses a computer, which can be programmed to construct intervals from 
raw data. 


EXAMPLE 6.2.4 


The following are the activity values (micromoles per minute per gram of tissue) of a 
certain enzyme measured in normal gastric tissue of 35 patients with gastric carcinoma. 


.360 1.189 .614 188 273 2.464 S571 
1.827 537 374 449 .262 .448 971 
372 .898 411 .348 1.925 .550 .622 
.610 .319 .406 .413 167 385 ‚674 
.521 .603 .533 .662 1.177 .307 1.499 


We wish to use the MINITAB computer software package to construct a 95 percent confi- 
dence interval for the population mean. Suppose we know that the population variance is .36. 
It is not necessary to assume that the sampled population of values is normally distributed 
since the sample size is sufficiently large for application of the central limit theorem. 


Solution: We enter the data into Column | and proceed as shown in Figure 6.2.2 . These 
instructions tell the computer that the reliability factor is z, that a 95 percent 
confidence interval is desired, that the population standard deviation is .6, and 
that the data are in Column 1. The output tells us that the sample mean is .718, 
the sample standard deviation is .511, and the standard error of the mean, 


cJ n is .6/V35 = .101. и 


We are 95 percent confident that the population mean is somewhere between .519 
and .917. Confidence intervals may be obtained through the use of many other software 
packages. Users of SAS®, for example, may wish to use the output from PROC MEANS or 
PROC UNIVARIATE to construct confidence intervals. 
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Dialog box: Session command: 


Stat » Basic Statistics » 1-Sample z MTB > ZINTERVAL 95 .6 C1 


Type C1 in Samples in Columns. 
Type .6 in Standard deviation. Click OK. 


Output: 
One-Sample Z: C1 
The assumed standard deviation = 0.600 


Variable N Mean StDev SE Mean 95.0 $ C.I. 
MicMoles 35 0.718 0.511 0.101 (0.519, 0.917) 


FIGURE 6.2.2 MINITAB procedure for constructing 95 percent confidence interval for a 
population mean, Example 6.2.4. 


Alternative Estimates of Central Tendency As noted previously, the 
mean is sensitive to extreme values—those values that deviate appreciably from most of the 
measurements in a data set. They are sometimes referred to as outliers. We also noted earlier 
that the median, because it is not so sensitive to extreme measurements, is sometimes 
preferred over the mean as a measure of central tendency when outliers are present. For the 
same reason, we may prefer to use the sample median as an estimator of the population 
median when we wish to make an inference about the central tendency of a population. Not 
only may we use the sample median as a point estimate of the population median, we also may 
construct a confidence interval for the population median. The formula is not given here but 
may be found in the book by Rice (1). 


Trimmed Mean  Estimators that are insensitive to outliers are called robust 
estimators. Another robust measure and estimator of central tendency is the trimmed 
mean. For a set of sample data containing n measurements we calculate the 100o percent 
trimmed mean as follows: 


1. Order the measurements. 


2. Discard the smallest 1000 percent and the largest 1000 percent of the measurements. 
The recommended value of o is something between .1 and .2. 


3. Compute the arithmetic mean of the remaining measurements. 


Note that the median may be regarded as a 50 percent trimmed mean. 


EXERCISES 


For each of the following exercises construct 90, 95, and 99 percent confidence intervals for the 
population mean, and state the practical and probabilistic interpretations of each. Indicate which 
interpretation you think would be more appropriate to use when discussing confidence intervals with 


6.2.1. 


6.2.2. 


6.2.3. 


6.2.4. 


6.2.5. 
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someone who has not had a course in statistics, and state the reason for your choice. Explain why the 
three intervals that you construct are not of equal width. Indicate which of the three intervals you 
would prefer to use as an estimate of the population mean, and state the reason for your choice. 


We wish to estimate the average number of heartbeats per minute for a certain population. The 
average number of heartbeats per minute for a sample of 49 subjects was found to be 90. Assume that 
these 49 patients constitute a random sample, and that the population is normally distributed with a 
standard deviation of 10. 


We wish to estimate the mean serum indirect bilirubin level of 4-day-old infants. The mean for a 
sample of 16 infants was found to be 5.98 mg/100 cc. Assume that bilirubin levels in 4-day-old infants 
are approximately normally distributed with a standard deviation of 3.5 mg/100 cc. 


In a length of hospitalization study conducted by several cooperating hospitals, a random sample of 
64 peptic ulcer patients was drawn from a list of all peptic ulcer patients ever admitted to the 
participating hospitals and the length of hospitalization per admission was determined for each. The 
mean length of hospitalization was found to be 8.25 days. The population standard deviation is known 
to be 3 days. 


A sample of 100 apparently normal adult males, 25 years old, had a mean systolic blood pressure of 
125. It is believed that the population standard deviation is 15. 


Some studies of Alzheimer's disease (AD) have shown an increase in CO» production in patients 
with the disease. In one such study the following '^CO» values were obtained from 16 neocortical 
biopsy samples from AD patients. 


1009 1280 1180 1255 1547 2352 1956 1080 
1776 1767 1680 2050 1452 2857 3100 1621 


Assume that the population of such values is normally distributed with a standard deviation of 350. 


6.3 THE t DISTRIBUTION 


In Section 6.2, a procedure was outlined for constructing a confidence interval for a 
population mean. The procedure requires knowledge of the variance of the population from 
which the sample is drawn. It may seem somewhat strange that one can have knowledge of 
the population variance and not know the value of the population mean. Indeed, it is the 
usual case, in situations such as have been presented, that the population variance, as well 
as the population mean, is unknown. This condition presents a problem with respect to 
constructing confidence intervals. Although, for example, the statistic 


х-и 
EZ 
is normally distributed when the population is normally distributed and is at least 
approximately normally distributed when n is large, regardless of the functional form 


of the population, we cannot make use of this fact because o is unknown. However, all is 
not lost, and the most logical solution to the problem is the one followed. We use the sample 


standard deviation 
A2 
= УУ - 3) /(n- 1) 


ра 
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to replace c. When the sample size is large, say, greater than 30, our faith in s as an 
approximation of o is usually substantial, and we may be appropriately justified in using 
normal distribution theory to construct a confidence interval for the population mean. In 
that event, we proceed as instructed in Section 6.2. 


It is when we have small samples that it becomes mandatory for us to find an 


alternative procedure for constructing confidence intervals. 


As a result of the work of Gosset (2), writing under the pseudonym of “Student,” an 


alternative, known as Student's t distribution, usually shortened to f distribution, is 
available to us. 


The quantity 


охо 


EZ 


І (6.3.1) 


follows this distribution. 


Properties of the t Distribution The : distribution has the following 
properties. 


1. 
2. 
3. 


It has a mean of 0. 
It is symmetrical about the mean. 


In general, it has a variance greater than 1, but the variance approaches 1 as the 
sample size becomes large. For df > 2, the variance of the f distribution is 
df/(df — 2), where df is the degrees of freedom. Alternatively, since here df — 
n — 1 for n > 3, we may write the variance of the 7 distribution as (n — 1)/(n — 3). 


4. The variable ¢ ranges from —oo to +00. 


The г distribution is really a family of distributions, since there is a different 
distribution for each sample value of n — 1, the divisor used in computing s?. We 
recall that n — 1 is referred to as degrees of freedom. Figure 6.3.1 shows t 
distributions corresponding to several degrees-of-freedom values. 


» Degrees of freedom - 30 
Degrees of freedom = 5 


Degrees of freedom = 2 


FIGURE 6.3.1 The t distribution for different degrees-of-freedom values. 
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— Normal distribution 
=== tdistribution 


FIGURE 6.3.2 Comparison of normal distribution and t distribution. 


6. Compared to the normal distribution, the t distribution is less peaked in the center and 
has thicker tails. Figure 6.3.2 compares the f distribution with the normal. 


7. The t distribution approaches the normal distribution as п — 1 approaches infinity. 


The ¢ distribution, like the standard normal, has been extensively tabulated. One such 
table is given as Table E in the Appendix. As we will see, we must take both the confidence 
coefficient and degrees of freedom into account when using the table of the + distribution. 

You may use MINITAB to graph the t distribution (for specified degrees-of-freedom 
values) and other distributions. After designating the horizontal axis by following direc- 
tions in the Set Patterned Data box, choose menu path Calc and then Probability 
Distributions. Finally, click on the distribution desired and follow the instructions. Use 
the Plot dialog box to plot the graph. 


Confidence Intervals Using t The general procedure for constructing confi- 
dence intervals is not affected by our having to use the 1 distribution rather than the standard 
normal distribution. We still make use of the relationship expressed by 


estimator + (reliability coefficient) x (standard error of the estimator) 


What is different is the source of the reliability coefficient. Itis now obtained from the table of 
the f distribution rather than from the table of the standard normal distribution. To be more 
specific, when sampling is from a normal distribution whose standard deviation, o, is 
unknown, the 100(1 — o) percent confidence interval for the population mean, u, is given by 


= 5 
X X Í(1-0/2) vn 


We emphasize that a requirement for the strictly valid use of the £ distribution is that the 
sample must be drawn from a normal distribution. Experience has shown, however, that 
moderate departures from this requirement can be tolerated. As a consequence, the t 
distribution is used even when it is known that the parent population deviates somewhat 
from normality. Most researchers require that an assumption of, at least, a mound-shaped 
population distribution be tenable. 


(6.3.2) 


EXAMPLE 6.3.1 


Maffulli et al. (A-1) studied the effectiveness of early weightbearing and ankle mobiliza- 
tion therapies following acute repair of a ruptured Achilles tendon. One of the variables 
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they measured following treatment was the isometric gastrocsoleus muscle strength. In 
19 subjects, the mean isometric strength for the operated limb (in newtons) was 250.8 with 
a standard deviation of 130.9. We assume that these 19 patients constitute a random sample 
from a population of similar subjects. We wish to use these sample data to estimate for the 
population the mean isometric strength after surgery. 


Solution: We may use the sample mean, 250.8, as a point estimate of the population 
mean but, because the population standard deviation is unknown, we must 
assume the population of values to be at least approximately normally 
distributed before constructing a confidence interval for u. Let us assume 
that such an assumption is reasonable and that a 95 percent confidence 
interval is desired. We have our estimator, x, and our standard error is 
5/ Ми = 130.9/\/19 = 30.0305. We need now to find the reliability 
coefficient, the value of t associated with a confidence coefficient of .95 
and n — 1 — 18 degrees of freedom. Since a 95 percent confidence interval 
leaves .05 of the area under the curve of t to be equally divided between the 
two tails, we need the value of t to the right of which lies .025 of the area. We 
locate in Appendix Table E the column headed f 975. This is the value of t to 
the left of which lies .975 of the area under the curve. The area to the right of 
this value is equal to the desired .025. We now locate the number 18 in the 
degrees-of-freedom column. The value at the intersection of the row labeled 
18 and the column labeled 1 975 is the t we seek. This value of t, which is our 
reliability coefficient, is found to be 2.1009. We now construct our 95 percent 
confidence interval as follows: 


250.8 + 2.1009(30.0305) 
250.8 + 63.1 
187.7,313.9 


This interval may be interpreted from both the probabilistic and practical points of view. 
We are 95 percent confident that the true population mean, jz, is somewhere between 187.7 
and 313.9 because, in repeated sampling, 95 percent of intervals constructed in like manner 
will include и. 


Deciding Between z and t When we construct a confidence interval for a 
population mean, we must decide whether to use a value of z or a value of t as the reliability 
factor. To make an appropriate choice we must consider sample size, whether the sampled 
population is normally distributed, and whether the population variance is known. Figure 
6.3.3 provides a flowchart that one can use to decide quickly whether the reliability factor 
should be z or t. 


Computer Analysis If you wish to have MINITAB construct a confidence 
interval for a population mean when the 7 statistic is the appropriate reliability factor, 
the command is TINTERVAL. In Windows choose 1-Sample : from the Basic Statistics 
menu. 


Population 
variance 
known? 


Population 
variance 
known? 
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Population 
normally 
distributed? 


Sample 
size 
large? 


Sample 
size 
large? 


Population 
variance 
known? 


Population 
variance 
known? 


t | z t z 2 5 p 
I 


or Central limit theorem applies 


FIGURE 6.3.3 Flowchart for use in deciding between z and t when making inferences about 
population means. (“Use a nonparametric procedure. See Chapter 13.) 


EXERCISES 


6.3.1. 


6.3.2. 


6.3.3. 


Use the г distribution to find the reliability factor for a confidence interval based on the following 
confidence coefficients and sample sizes: 


a b с а 
Confidence coefficient .95 .99 .90 .95 
Sample size 15 24 8 30 


In a study of the effects of early Alzheimer's disease on nondeclarative memory, Reber et al. (A-2) 
used the Category Fluency Test to establish baseline persistence and semantic memory and language 
abilities. The eight subjects in the sample had Category Fluency Test scores of 11, 10, 6, 3, 11, 10, 9, 
11. Assume that the eight subjects constitute a simple random sample from a normally distributed 
population of similar subjects with early Alzheimer's disease. 


(a) 
(b) 
(c) 
(d) 
(e) 
(f) 
(g) 


What is the point estimate of the population mean? 

What is the standard deviation of the sample? 

What is the estimated standard error of the sample mean? 

Construct a 95 percent confidence interval for the population mean category fluency test score. 
What is the precision of the estimate? 

State the probabilistic interpretation of the confidence interval you constructed. 


State the practical interpretation of the confidence interval you constructed. 


Pedroletti et al. (A-3) reported the maximal nitric oxide diffusion rate in a sample of 15 asthmatic 
schoolchildren and 15 controls as mean + standard error of the mean. For asthmatic children, they 
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6.3.4. 


6.3.5. 


6.3.6. 


reported 3.5 + 0.4 nL/s (nanoliters per second) and for control subjects they reported 0.7 + .1 nL/s. 
For each group, determine the following: 


(a) What was the sample standard deviation? 

(b) Whatis the 95 percent confidence interval for the mean maximal nitric oxide diffusion rate of the 
population? 

(c) What assumptions are necessary for the validity of the confidence interval you constructed? 
(d) What are the practical and probabilistic interpretations of the interval you constructed? 


(e) Which interpretation would be more appropriate to use when discussing confidence intervals 
with someone who has not had a course in statistics? State the reasons for your choice. 


(f) If you were to construct a 90 percent confidence interval for the population mean from the 
information given here, would the interval be wider or narrower than the 95 percent confidence 
interval? Explain your answer without actually constructing the interval. 
(g) If you were to construct a 99 percent confidence interval for the population mean from the 
information given here, would the interval be wider or narrower than the 95 percent confidence 
interval? Explain your answer without actually constructing the interval. 


The concern of a study by Beynnon et al. (A-4) were nine subjects with chronic anterior 
cruciate ligament (ACL) tears. One of the variables of interest was the laxity of the anteroposterior, 
where higher values indicate more knee instability. The researchers found that among subjects 
with ACL-deficient knees, the mean laxity value was 17.4 mm with a standard deviation of 
4.3 mm. 


(a) What is the estimated standard error of the mean? 


(b) Construct the 99 percent confidence interval for the mean of the population from which the nine 
subjects may be presumed to be a random sample. 


(c) What is the precision of the estimate? 


(d) What assumptions are necessary for the validity of the confidence interval you constructed? 


A sample of 16 ten-year-old girls had a mean weight of 71.5 and a standard deviation of 12 pounds, 
respectively. Assuming normality, find the 90, 95, and 99 percent confidence intervals for и. 


The subjects of a study by Dugoff et al. (A-5) were 10 obstetrics and gynecology interns at the 
University of Colorado Health Sciences Center. The researchers wanted to assess competence in 
performing clinical breast examinations. One of the baseline measurements was the number of such 
examinations performed. The following data give the number of breast examinations performed for 
this sample of 10 interns. 


Intern Number No. of Breast Exams Performed 

1 30 
2 40 
3 8 
4 20 Source: Lorraine Dugoff, Mauritha R. 
5 26 Everett, Louis Vontver, апа Gwyn E. 
6 35 Barley, “Evaluation of Pelvic and Breast 
7 35 Examination Skills of Interns in 
8 20 Obstetrics and Gynecology and Internal 
9 25 Medicine," American Journal of 

10 20 Obstetrics and Gynecology, 189 (2003), 


655-658. 
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Construct a 95 percent confidence interval for the mean of the population from which the study 
subjects may be presumed to have been drawn. 


6.4 CONFIDENCE INTERVAL FOR 
THE DIFFERENCE BETWEEN TWO 
POPULATION MEANS 


Sometimes there arise cases in which we are interested in estimating the difference 
between two population means. From each of the populations an independent random 
sample is drawn and, from the data of each, the sample means x; and x», respectively, are 
computed. We learned in the previous chapter that the estimator x; — x» yields an unbiased 
estimate of шу — ua, the difference between the population means. The variance of the 
estimator is (oi / пі) + (оз у n). We also know from Chapter 5 that, depending on the 
conditions, the sampling distribution of x; — хә may be, at least, approximately normally 
distributed, so that in many cases we make use of the theory relevant to normal distributions 
to compute a confidence interval for шу — и». When the population variances are known, 
the 100(1 — о) percent confidence interval for шу — шә is given by 


2 2: 
ая E (6.4.1) 
п п» 


An examination of a confidence interval for the difference between population means 
provides information that is helpful in deciding whether or not it is likely that the two 
population means are equal. When the constructed interval does not include zero, we say 
that the interval provides evidence that the two population means are not equal. When the 
interval includes zero, we say that the population means may be equal. 

Let us illustrate a case where sampling is from the normal distributions. 


EXAMPLE 6.4.1 


A research team is interested in the difference between serum uric acid levels in patients 
with and without Down's syndrome. In a large hospital for the treatment of the mentally 
challenged, a sample of 12 individuals with Down's syndrome yielded a mean of 
Xi = 4.5 mg/100 ml. In a general hospital a sample of 15 normal individuals of the 
same age and sex were found to have a mean value of x; = 3.4. If it is reasonable to assume 
that the two populations of values are normally distributed with variances equal to 1 and 
1.5, find the 95 percent confidence interval for шу — u2. 


Solution: For a point estimate of шу — м», we use x, — Хо = 4.5 — 3.4 = 1.1. The 
reliability coefficient corresponding to .95 is found in Appendix Table D to be 
1.96. The standard error is 
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The 95 percent confidence interval, then, is 


1.1 + 1.96(.4282) 
1.1 5.84 
(.26, 1.94) 


We say that we are 95 percent confident that the true difference, 
ра = Шә, is somewhere between .26 and 1.94 because, in repeated sampling, 
95 percent of the intervals constructed in this manner would include the 
difference between the true means. 

Since the interval does not include zero, we conclude that the two 
population means are not equal. EH 


Sampling from Non-normal Populations The construction of a confi- 
dence interval for the difference between two population means when sampling is from 
non-normal populations proceeds in the same manner as in Example 6.4.1 if the sample 
sizes n, and п» are large. Again, this is a result of the central limit theorem. If the population 
variances are unknown, we use the sample variances to estimate them. 


EXAMPLE 6.4.2 


Despite common knowledge of the adverse effects of doing so, many women continue to 
smoke while pregnant. Mayhew et al. (A-6) examined the effectiveness of a smoking 
cessation program for pregnant women. The mean number of cigarettes smoked daily at the 
close of the program by the 328 women who completed the program was 4.3 with a 
standard deviation of 5.22. Among 64 women who did not complete the program, the mean 
number of cigarettes smoked per day at the close of the program was 13 with a standard 
deviation of 8.97. We wish to construct a 99 percent confidence interval for the difference 
between the means of the populations from which the samples may be presumed to have 
been selected. 


Solution: No information is given regarding the shape of the distribution of cigarettes 
smoked per day. Since our sample sizes are large, however, the central limit 
theorem assures us that the sampling distribution of the difference between 
sample means will be approximately normally distributed even if the 
distribution of the variable in the populations is not normally distributed. 
We may use this fact as justification for using the z statistic as the reliability 
factor in the construction of our confidence interval. Also, since the popula- 
tion standard deviations are not given, we will use the sample standard 
deviations to estimate them. The point estimate for the difference between 
population means is the difference between sample means, 4.3 — 13.0 — 
—8.7. In Appendix Table D we find the reliability factor to be 2.58. The 
estimated standard error is 


522 8.972 
ллу — —: 1.1577 
ck 328 ' 64 
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By Equation 6.4.1, our 99 percent confidence interval for the difference 
between population means is 


—8.7 + 2.58(1.1577) 
(—117,—5.7) 


We are 99 percent confident that the mean number of cigarettes smoked per 
day for women who complete the program is between 5.7 and 11.7 lower than 
the mean for women who do not complete the program. и 


The t Distribution and the Difference Between Means When 
population variances are unknown, and we wish to estimate the difference between two 
population means with a confidence interval, we can use the f distribution as a source of the 
reliability factor if certain assumptions are met. We must know, or be willing to assume, 
that the two sampled populations are normally distributed. With regard to the population 
variances, we distinguish between two situations: (1) the situation in which the population 
variances are equal, and (2) the situation in which they are not equal. Let us consider each 
situation separately. 


Population Variances Equal Ifthe assumption of equal population variances 
is justified, the two sample variances that we compute from our two independent samples 
may be considered as estimates of the same quantity, the common variance. It seems 
logical, then, that we should somehow capitalize on this in our analysis. We do just that and 
obtain a pooled estimate of the common variance. This pooled estimate is obtained by 
computing the weighted average of the two sample variances. Each sample variance is 
weighted by its degrees of freedom. If the sample sizes are equal, this weighted average is 
the arithmetic mean of the two sample variances. If the two sample sizes are unequal, the 
weighted average takes advantage of the additional information provided by the larger 
sample. The pooled estimate is given by the formula 
› _ (m — Пя + (ms 


= 6.4.2 
5› n +m-—2 ( ) 


The standard error of the estimate, then, is given by 


52 52 
Sy» = mu (6.4.3) 


82 52 
Хі = Хх If. WES 
( 1 X) (1-а/2) i " (6 ) 


The number of degrees of freedom used in determining the value of t to use in constructing 
the interval is nı + m — 2, the denominator of Equation 6.4.2. We interpret this interval 
in the usual manner. 

Methods that may be used in reaching a decision about the equality of population 
variances are discussed in Sections 6.10 and 7.8. 
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EXAMPLE 6.4.3 


The purpose of a study by Granholm et al. (A-7) was to determine the effectiveness of an 
integrated outpatient dual-diagnosis treatment program for mentally ill subjects. The 
authors were addressing the problem of substance abuse issues among people with severe 
mental disorders. A retrospective chart review was performed on 50 consecutive patient 
referrals to the Substance Abuse/Mental Illness program at the VA San Diego Healthcare 
System. One of the outcome variables examined was the number of inpatient treatment 
days for psychiatric disorder during the year following the end of the program. Among 18 
subjects with schizophrenia, the mean number of treatment days was 4.7 with a standard 
deviation of 9.3. For 10 subjects with bipolar disorder, the mean number of psychiatric 
disorder treatment days was 8.8 with a standard deviation of 11.5. We wish to construct a 95 
percent confidence interval for the difference between the means of the populations 
represented by these two samples. 


Solution: First we use Equation 6.4.2 to compute the pooled estimate of the common 
population variance. 


18 — 1) (9.32 10 — 1)(11.5)° 
dot (9.37) + ( X 10598 
р 18-1027 


When we enter Appendix Table E with 18 + 10 — 2 — 26 degrees of freedom 
and a desired confidence level of .95, we find that the reliability factor is 
2.0555. By Expression 6.4.4 we compute the 95 percent confidence interval 
for the difference between population means as follows: 


102.33 102.33 


(4.7 — 8.8) + 2.0555 


18 10 
—4.1 x: 8.20 
(-123, 4.1) 


We are 95 percent confident that the difference between population means is 
somewhere between - 12.3 and 4.10. We can say this because we know that if 
we were to repeat the study many, many times, and compute confidence 
intervals in the same way, about 95 percent of the intervals would include the 
difference between the population means. 

Since the interval includes zero, we conclude that the population means 
may be equal. и 


Population Variances Not Equal When one is unable to conclude that the 
variances of two populations of interest are equal, even though the two populations may be 
assumed to be normally distributed, it is not proper to use the f distribution as just outlined 
in constructing confidence intervals. 

As a practical rule in applied problems, one may wish to assume the inequality of 
variances if the ratio of the larger to the smaller variance exceeds 2; however, a more formal 
test is described in Section 6.10. 
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A solution to the problem of unequal variances was proposed by Behrens (3) and 
later was verified and generalized by Fisher (4,5). Solutions have also been proposed by 
Neyman (6), Scheffé (7,8), and Welch (9,10). The problem is discussed in detail by 
Cochran (11). 

The problem revolves around the fact that the quantity 


Q1 — 3) — (ш — Ма) 


INE: 
+= 
ni n» 


does not follow a t distribution with n; + m — 2 degrees of freedom when the population 
variances are not equal. Consequently, the ¢ distribution cannot be used in the usual way to 
obtain the reliability factor for the confidence interval for the difference between the means 
of two populations that have unequal variances. The solution proposed by Cochran consists 
of computing the reliability factor, ^ n by the following formula: 


Wil) + Wolo 
порно ог (64.5) 


where wı = s? пі, мо = 52/0, ti = 11 a5 for nı - 1 degrees of freedom, and 15 = ао 
for m — 1 degrees of freedom. An approximate 100(1 — о) percent confidence interval for 
Ші = Шо is given by 


2 2. 
= уе $1 $5 
(X1 = X3) zE I (1.9/2) "m + 35 (6.4.6) 


Adjustments to the reliability coefficient may also be made by reducing the number of 
degrees of freedom instead of modifying t in the manner just demonstrated. Many 
computer programs calculate an adjusted reliability coefficient in this way. 


EXAMPLE 6.4.4 


Let us reexamine the data presented in Example 6.4.3 from the study by Granholm et al. 
(A-7). Recall that among the 18 subjects with schizophrenia, the mean number of treatment 
days was 4.7 with a standard deviation of 9.3. In the bipolar disorder treatment group of 10 
subjects, the mean number of psychiatric disorder treatment days was 8.8 with a standard 
deviation of 11.5. We assume that the two populations of number of psychiatric disorder 
days are approximately normally distributed. Now let us assume, however, that the two 
population variances are not equal. We wish to construct a 95 percent confidence interval 
for the difference between the means of the two populations represented by the samples. 


Solution: We will use Г as found in Equation 6.4.5 for the reliability factor. Reference 
to Appendix Table E shows that with 17 degrees of freedom and 
1 — .05/2 = .975, t, = 2.1098. Similarly, with 9 degrees of freedom and 
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| ji Central limit theorem applies 
r4 2 
FIGURE 6.4.1 Flowchart for use іп deciding whether the reliability factor should be 2, t, or t' 


when making inferences about the difference between two population means. (*Use a 


nonparametric procedure. See Chapter 13.) 


1 — .05/2 = .975, t; = 2.2622. We now compute 


, _ (9.37/18) (2.1098) + (11.5?/10) (2.2622) _ 
d (9.32/18) + (11.52/10) noa 


By Expression 6.4.6 we now construct the 95 percent confidence interval for 
the difference between the two population means. 


9.32 11.52 
(4.7 — 8.8) + 2.2216 UT UE 
(4.7 — 8.8) + 2.2216(4.246175) 
—13.5,5.3 


Since the interval does include zero, we conclude that the two population 
means may be equal. 

An example of this type of calculation using program R, which uses 
Welch's approximation to the problem of unequal variances, is provided in 
Figure 6.4.2. Notice that there is a slight difference in the endpoints of the 
interval. E 


When constructing a confidence interval for the difference between two population 
means one may use Figure 6.4.1 to decide quickly whether the reliability factor should be 
z, t, or f. 
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R Code: 
> tsum.test(mean.x = 4.7, $.х = 9.3, n.x = 18, mean.y = 8.8, s.y = 11.5, п.у = 10, alternative = 
“two.sided”, mu — 0, var.equal = FALSE, conf.level — 0.95) 


ROutput: 
Welch Modified Two-Sample t-Test 


data: Summarized x and y 
t= —0.9656, df = 15.635, p-value = 0.349 
alternative hypothesis: true difference in means is not equal to 0 


95 percent confidence interval: 
—13.118585 4.918585 


sample estimates: 
mean of x mean of y 
4.7 8.8 


FIGURE 6.4.2 Program R example calculation for the confidence interval between two means 
assuming unequal variances using the data in Example 6.4.4. 


EXERCISES 


6.4.1. 


6.4.2. 


6.4.3. 


6.4.4. 


For each of the following exercises construct 90, 95, and 99 percent confidence intervals for the 
difference between population means. Where appropriate, state the assumptions that make your 
method valid. State the practical and probabilistic interpretations of each interval that you construct. 
Consider the variables under consideration in each exercise, and state what use you think researchers 
might make of your results. 


Iannelo et al. (A-8) performed a study that examined free fatty acid concentrations in 18 lean subjects 
and 11 obese subjects. The lean subjects had a mean level of 299 uEg/L with a standard error of the 
mean of 30, while the obese subjects had a mean of 744 uEq/L with a standard error of the mean of 62. 


Chan et al. (A-9) developed a questionnaire to assess knowledge of prostate cancer. There was a total of 
36 questions to which respondents could answer “agree,” “disagree,” or “don’t know." Scores could 
range from 0 to 36. The mean scores for Caucasian study participants was 20.6 with a standard deviation 
of 5.8, while the mean scores for African-American men was 17.4 with a standard deviation of 5.8. The 
number of Caucasian study participants was 185, and the number of African-Americans was 86. 


The objectives of a study by van Vollenhoven et al. (A-10) were to examine the effectiveness of 
etanercept alone and etanercept in combination with methotrexate in the treatment of rheumatoid 
arthritis. The researchers conducted a retrospective study using data from the STURE database, 
which collects efficacy and safety data for all patients starting biological treatments at the major 
hospitals in Stockholm, Sweden. The researchers identified 40 subjects who were prescribed 
etanercept only and 57 subjects who were given etanercept with methotrexate. Using a 100-mm 
visual analogue scale (the higher the value, the greater the pain), researchers found that after 3 months 
of treatment, the mean pain score was 36.4 with a standard error of the mean of 5.5 for subjects taking 
etanercept only. In the sample receiving etanercept plus methotrexate, the mean score was 30.5 with a 
standard error of the mean of 4.6. 


The purpose of a study by Nozawa et al. (A-11) was to determine the effectiveness of segmental wire 
fixation in athletes with spondylolysis. Between 1993 and 2000, 20 athletes (6 women and 14 men) 


184  cHAPTER6 ESTIMATION 


6.4.5. 


6.4.6. 


6.4.7. 


6.4.8. 


6.4.9. 


6.4.10. 


with lumbar spondylolysis were treated surgically with the technique. The following table gives the 
Japanese Orthopaedic Association (JOA) evaluation score for lower back pain syndrome for men and 
women prior to the surgery. The lower score indicates less pain. 


Gender JOA scores 


Female 14, 13, 24, 21, 20, 21 

Male 21, 26, 24, 24, 22, 23, 18, 24, 13, 22, 25, 23, 21, 25 
Source: Satoshi Nozawa, Katsuji Shimizu, Kei Miyamoto, and Mizuo 
Tanaka, “Repair of Pars Interarticularis Defect by Segmental Wire 


Fixation in Young Athletes with Spondylolysis," American Journal of 
Sports Medicine, 31 (2003), 359—364. 


Krantz et al. (A-12) investigated dose-related effects of methadone in subjects with torsade 
de pointes, a polymorphic ventricular tachycardia. In the study of 17 subjects, nine were being 
treated with methadone for opiate dependency and eight for chronic pain. The mean daily 
dose of methadone in the opiate dependency group was 541 mg/day with a standard deviation of 
156, while the chronic pain group received a mean dose of 269 mg/day with a standard deviation 
of 316. 


Transverse diameter measurements on the hearts of adult males and females gave the following 
results: 


Group Sample Size x (cm) s (cm) 
Males 12 13.21 1.05 
Females 9 11.00 1.01 


Assume normally distributed populations with equal variances. 


Twenty-four experimental animals with vitamin D deficiency were divided equally into two groups. 
Group 1 received treatment consisting of a diet that provided vitamin D. The second group was not 
treated. At the end of the experimental period, serum calcium determinations were made with the 
following results: 


Treated group: 
Untreated group: 


11.1 mg/100 ml, s = 1.5 
— 7.8mg/100 ml, s — 2.0 


Assume normally distributed populations with equal variances. 


Two groups of children were given visual acuity tests. Group 1 was composed of 11 children who 
receive their health care from private physicians. The mean score for this group was 26 with a 
standard deviation of 5. Group 2 was composed of 14 children who receive their health care from the 
health department, and had an average score of 21 with a standard deviation of 6. Assume normally 
distributed populations with equal variances. 


The average length of stay of a sample of 20 patients discharged from a general hospital was 7 days 
with a standard deviation of 2 days. A sample of 24 patients discharged from a chronic disease 
hospital had an average length of stay of 36 days with a standard deviation of 10 days. Assume 
normally distributed populations with unequal variances. 


In a study of factors thought to be responsible for the adverse effects of smoking on human 
reproduction, cadmium level determinations (nanograms per gram) were made on placenta tissue of a 
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sample of 14 mothers who were smokers and an independent random sample of 18 nonsmoking 
mothers. The results were as follows: 


Nonsmokers: 10.0, 8.4, 12.8, 25.0, 11.8, 9.8, 12.5, 15.4, 23.5, 
9.4, 25.1, 19.5, 25.5, 9.8, 7.5, 11.8, 12.2, 15.0 


Smokers: 30.0, 30.1, 15.0, 24.1, 30.5, 17.8, 16.8, 14.8, 
13.4, 28.5, 17.5, 14.4, 12.5, 20.4 


Does it appear likely that the mean cadmium level is higher among smokers than nonsmokers? Why 
do you reach this conclusion? 


6.5 CONFIDENCE INTERVAL FOR 
A POPULATION PROPORTION 


Many questions of interest to the health worker relate to population proportions. What 
proportion of patients who receive a particular type of treatment recover? What proportion 
of some population has a certain disease? What proportion of a population is immune to a 
certain disease? 

To estimate a population proportion we proceed in the same manner as when 
estimating a population mean. A sample is drawn from the population of interest, and the 
sample proportion, p, is computed. This sample proportion is used as the point estimator of 
the population proportion. A confidence interval is obtained by the general formula 


estimator + (reliability coefficient) x (standard error of the estimator) 


In the previous chapter we saw that when both np and n(1 — p) are greater than 5, we 
may consider the sampling distribution of p to be quite close to the normal distribution. 
When this condition is met, our reliability coefficient is some value of z from the standard 
normal distribution. The standard error, we have seen, is equal to ор = \/p(1 — p)/n. 
Since p, the parameter we are trying to estimate, is unknown, we must use p as an estimate. 
Thus, we estimate оу by \/p(1 — p)/n, and our 100(1 — о) percent confidence interval 
for p is given by 


P zia VPU p)/n (6.5.1) 


We give this interval both the probabilistic and practical interpretations. 


EXAMPLE 6.5.1 


The Pew Internet and American Life Project (A-13) reported in 2003 that 18 percent of 
Internet users have used it to search for information regarding experimental treatments or 
medicines. The sample consisted of 1220 adult Internet users, and information was 
collected from telephone interviews. We wish to construct a 95 percent confidence interval 
for the proportion of Internet users in the sampled population who have searched for 
information on experimental treatments or medicines. 
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Solution: We shall assume that the 1220 subjects were sampled in random 
fashion. The best point estimate of the population proportion is p — .18. 
The size of the sample and our estimate of p are of sufficient magnitude 
to justify use of the standard normal distribution in constructing a 
confidence interval. The reliability coefficient corresponding to a confi- 
dence level of .95 is 1.96, and our estimate of the standard error оў is 


УР — p) /n = 4/(.18)(.82)/1220 = .0110. The 95 percent confidence 
interval for p, based on these data, is 


.18 + 1.96(.0110) 
18 + .022 
158, .202 


We are 95 percent confident that the population proportion p is between .158 
and .202 because, in repeated sampling, about 95 percent of the intervals 
constructed in the manner of the present single interval would include the true 
p. On the basis of these results we would expect, with 95 percent confidence, to 
find somewhere between 15.8 percent and 20.2 percent of adult Internet users to 
have used it for information on medicine or experimental treatments. E 


EXERCISES 


6.5.1. 


6.5.2. 


6.5.3. 


6.5.4. 


For each of the following exercises state the practical and probabilistic interpretations of the interval 
that you construct. Identify each component of the interval: point estimate, reliability coefficient, and 
standard error. Explain why the reliability coefficients are not the same for all exercises. 


Luna et al. (A-14) studied patients who were mechanically ventilated in the intensive care unit of six 
hospitals in Buenos Aires, Argentina. The researchers found that of 472 mechanically ventilated 
patients, 63 had clinical evidence of ventilator-associated pneumonia (VAP). Construct a 95 percent 
confidence interval for the proportion of all mechanically ventilated patients at these hospitals who 
may be expected to develop VAP. 


Q waves on the electrocardiogram, according to Schinkel et al. (A-15), are often considered to be 
reflective of irreversibly scarred myocardium. These researchers assert, however, that there are some 
indications that residual viable tissue may be present in Q-wave-infarcted regions. Their study of 150 
patients with chronic electrocardiographic Q-wave infarction found 202 dysfunctional Q-wave regions. 
With dobutamine stress echocardiography (DSE), they noted that 118 of these 202 regions were viable 
with information from the DSE testing. Construct a 90 percent confidence interval for the proportion of 
viable regions that one might expect to find a population of dysfunctional Q-wave regions. 


In a study by von zur Muhlen et al. (A-16), 136 subjects with syncope or near syncope were studied. 
Syncope is the temporary loss of consciousness due to a sudden decline in blood flow to the brain. Of 
these subjects, 75 also reported having cardiovascular disease. Construct a 99 percent confidence 
interval for the population proportion of subjects with syncope or near syncope who also have 
cardiovascular disease. 


In a simple random sample of 125 unemployed male high-school dropouts between the ages of 16 
and 21, inclusive, 88 stated that they were regular consumers of alcoholic beverages. Construct a 
95 percent confidence interval for the population proportion. 
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6.6 CONFIDENCE INTERVAL FOR 
THE DIFFERENCE BETWEEN TWO 
POPULATION PROPORTIONS 


The magnitude of the difference between two population proportions is often of interest. We 
may want to compare, for example, men and women, two age groups, two socioeconomic 
groups, or two diagnostic groups with respect to the proportion possessing some characteris- 
tic of interest. An unbiased point estimator of the difference between two population 
proportions is provided by the difference between sample proportions, p, - р». As we 
have seen, when n, and п» are large and the population proportions are not too close to 0 or 1, 
the central limit theorem applies and normal distribution theory may be employed to obtain 
confidence intervals. The standard error of the estimate usually must be estimated by 


| үс ЕХ 


Os == 
P17P2 n пә 


because, as a rule, the population proportions are unknown. A 100(1 — o) percent 
confidence interval for p, — р» is given by 


ee e jee ANANA eds 


We may interpret this interval from both the probabilistic and practical points of view. 


EXAMPLE 6.6.1 


Connor et al. (A-17) investigated gender differences in proactive and reactive aggression in 
a sample of 323 children and adolescents (68 females and 255 males). The subjects were 
from unsolicited consecutive referrals to a residential treatment center and a pediatric 
psychopharmacology clinic serving a tertiary hospital and medical school. In the sample, 
31 of the females and 53 of the males reported sexual abuse. We wish to construct a 99 
percent confidence interval for the difference between the proportions of sexual abuse in 
the two sampled populations. 


Solution: The sample proportions for the females and males are, respectively, рр = 
31/68 — .4559 and p,, — 53/255 — .2078. The difference between sample 
proportions is Pp — py = .4559 — .2078 = .2481. The estimated standard 
error of the difference between sample proportions is 


| (.4559)(.5441) | (.2078)(.7922) 
Crd — 68 x 255 


— .0655 


The reliability factor from Appendix Table D is 2.58, so that our confidence 
interval, by Expression 6.6.1, is 


2481 + 2.58(.0655) 
0791, 4171 
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We are 99 percent confident that for the sampled populations, the proportion 
of cases of reported sexual abuse among females exceeds the proportion of 
cases of reported sexual abuse among males by somewhere between .0791 


and .4171. 
Since the interval does not include zero, we conclude that the two 
population proportions are not equal. || 


EXERCISES 


6.6.1. 


6.6.2. 


6.6.3. 


6.6.4. 


For each of the following exercises state the practical and probabilistic interpretations of the interval 
that you construct. Identify each component of the interval: point estimate, reliability coefficient, and 
standard error. Explain why the reliability coefficients are not the same for all exercises. 


Horwitz et al. (A-18) studied 637 persons who were identified by court records from 1967 to 1971 as 
having experienced abuse or neglect. For a control group, they located 510 subjects who as children 
attended the same elementary school and lived within a five-block radius of those in the 
abused/neglected group. In the abused/neglected group, and control group, 114 and 57 subjects, 
respectively, had developed antisocial personality disorders over their lifetimes. Construct a 95 
percent confidence interval for the difference between the proportions of subjects developing 
antisocial personality disorders one might expect to find in the populations of subjects from which 
the subjects of this study may be presumed to have been drawn. 


The objective of a randomized controlled trial by Adab et al. (A-19) was to determine whether providing 
women with additional information on the pros and cons of screening for cervical cancer would increase 
the willingness to be screened. A treatment group of 138 women received a leaflet on screening that 
contained more information (average individual risk for cervical cancer, likelihood of positive finding, 
the possibility of false positive/negative results, etc.) than the standard leaflet developed by the British 
National Health Service that 136 women іп a control group received. In the treatment group, 109 women 
indicated they wanted to have the screening test for cervical cancer while in the control group, 120 
indicated they wanted the screening test. Construct a 95 percent confidence interval for the difference in 
proportions for the two populations represented by these samples. 


Spertus et al. (A-20) performed a randomized single blind study for subjects with stable coronary 
artery disease. They randomized subjects into two treatment groups. The first group had current 
angina medications optimized, and the second group was tapered off existing medications and then 
started on long-acting diltiazem at 180 mg/day. The researchers performed several tests to determine 
if there were significant differences in the two treatment groups at baseline. One of the characteristics 
of interest was the difference in the percentages of subjects who had reported a history of congestive 
heart failure. In the group where current medications were optimized, 16 of 49 subjects reported a 
history of congestive heart failure. In the subjects placed on the diltiazem, 12 of the 51 subjects 
reported a history of congestive heart failure. State the assumptions that you think are necessary and 
construct a 95 percent confidence interval for the difference between the proportions of those 
reporting congestive heart failure within the two populations from which we presume these treatment 
groups to have been selected. 


To study the difference in drug therapy adherence among subjects with depression who received usual 
care and those who received care in a collaborative care model was the goal of a study conducted by 
Finley et al. (A-21). The collaborative care model emphasized the role of clinical pharmacists in 
providing drug therapy management and treatment follow-up. Of the 50 subjects receiving usual care, 
24 adhered to the prescribed drug regimen, while 50 out of 75 subjects in the collaborative care model 


6.7 DETERMINATION OF SAMPLE SIZE FOR ESTIMATING MEANS 189 


adhered to the drug regimen. Construct a 90 percent confidence interval for the difference in 
adherence proportions for the populations of subjects represented by these two samples. 


6.7 DETERMINATION OF SAMPLE SIZE 
FOR ESTIMATING MEANS 


The question of how large a sample to take arises early in the planning of any survey or 
experiment. This is an important question that should not be treated lightly. To take a larger 
sample than is needed to achieve the desired results is wasteful of resources, whereas very 
small samples often lead to results that are of no practical use. Let us consider, then, how 
one may go about determining the sample size that is needed in a given situation. In this 
section, we present a method for determining the sample size required for estimating a 
population mean, and in the next section we apply this method to the case of sample size 
determination when the parameter to be estimated is a population proportion. By 
straightforward extensions of these methods, sample sizes required for more complicated 
situations can be determined. 


Objectives The objectives in interval estimation are to obtain narrow intervals with 
high reliability. If we look at the components of a confidence interval, we see that the width 
of the interval is determined by the magnitude of the quantity 


(reliability coefficient) x (standard error of the estimator) 


since the total width of the interval is twice this amount. We have learned that this quantity 
is usually called the precision of the estimate or the margin of error. For a given standard 
error, increasing reliability means a larger reliability coefficient. But a larger reliability 
coefficient for a fixed standard error makes for a wider interval. 

On the other hand, if we fix the reliability coefficient, the only way to reduce the 
width of the interval is to reduce the standard error. Since the standard error is equal to 
c / n, and since ø is a constant, the only way to obtain a small standard error is to take a 
large sample. How large a sample? That depends on the size of c, the population standard 
deviation, the desired degree of reliability, and the desired interval width. 

Let us suppose we want an interval that extends d units on either side of the estimator. 
We can write 


d — (reliability coefficient) x (standard error of the estimator) (6.7.1) 


If sampling is to be with replacement, from an infinite population, or from a 
population that is sufficiently large to warrant our ignoring the finite population correction, 
Equation 6.7.1 becomes 


с 
d = :—= 6.7.2 
5 m ( ) 
which, when solved for n, gives 
229 
йл і (6.7.3) 
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When sampling is without replacement from a small finite population, the finite population 
correction is required and Equation 6.7.1 becomes 


o |М-п 
d=z— 6.7.4 
© UR N-1 ( ) 
which, when solved for n, gives 
№20? 
n = > (6.7.5) 


d*(N — 1) + 202 


If the finite population correction can be ignored, Equation 6.7.5 reduces to 
Equation 6.7.3. 


Estimating o? The formulas for sample size require knowledge of o? but, as has 
been pointed out, the population variance is, as a rule, unknown. As a result, о? has to be 
estimated. The most frequently used sources of estimates for o? are the following: 


1. A pilot or preliminary sample may be drawn from the population, and the variance 
computed from this sample may be used as an estimate of o?. Observations used in 
the pilot sample may be counted as part of the final sample, so that n (the computed 
sample size) —n, (the pilot sample size) = п» (the number of observations needed to 
satisfy the total sample size requirement). 


2. Estimates of o? may be available from previous or similar studies. 


3. If it is thought that the population from which the sample is to be drawn is 
approximately normally distributed, one may use the fact that the range is approxi- 
mately equal to six standard deviations and compute o яз R/6. This method requires 
some knowledge of the smallest and largest value of the variable in the population. 


EXAMPLE 6.7.1 


A health department nutritionist, wishing to conduct a survey among a population of 
teenage girls to determine their average daily protein intake (measured in grams), is 
seeking the advice of a biostatistician relative to the sample size that should be taken. 

What procedure does the biostatistician follow in providing assistance to the 
nutritionist? Before the statistician can be of help to the nutritionist, the latter must 
provide three items of information: (1) the desired width of the confidence interval, (2) the 
level of confidence desired, and (3) the magnitude of the population variance. 


Solution: Let us assume that the nutritionist would like an interval about 10 grams 
wide; that is, the estimate should be within about 5 grams of the population 
mean in either direction. In other words, a margin of error of 5 grams is 
desired. Let us also assume that a confidence coefficient of .95 is decided 
on and that, from past experience, the nutritionist feels that the population 
standard deviation is probably about 20 grams. The statistician now has 
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the necessary information to compute the sample size: z = 1.96, с = 20 
and d — 5. Let us assume that the population of interest is large so that 
the statistician may ignore the finite population correction and use 
Equation 6.7.3. On making proper substitutions, the value of n is found 
to be 


(1.96)? (20 


(5) 
= 61.47 


The nutritionist is advised to take a sample of size 62. When calculating 
a sample size by Equation 6.7.3 or Equation 6.7.5, we round up to the next- 
largest whole number if the calculations yield a number that is not itself an 
integer. и 


EXERCISES 


6.7.1. A hospital administrator wishes to estimate the mean weight of babies born in her hospital. How large 
a sample of birth records should be taken if she wants a 99 percent confidence interval that is 1 pound 
wide? Assume that a reasonable estimate of с is 1 pound. What sample size is required if the 
confidence coefficient is lowered to .95? 


6.7.2. The director of the rabies control section in a city health department wishes to draw a sample from the 
department's records of dog bites reported during the past year in order to estimate the mean age of 
persons bitten. He wants a 95 percent confidence interval, he will be satisfied to let d — 2.5, and from 
previous studies he estimates the population standard deviation to be about 15 years. How large a 
sample should be drawn? 


6.7.3. А physician would like to know the mean fasting blood glucose value (milligrams per 100 ml) of 
patients seen in a diabetes clinic over the past 10 years. Determine the number of records the 
physician should examine in order to obtain a 90 percent confidence interval for у if the desired width 
of the interval is 6 units and a pilot sample yields a variance of 60. 


6.7.4. For multiple sclerosis patients we wish to estimate the mean age at which the disease was first 
diagnosed. We want a 95 percent confidence interval that is 10 years wide. If the population variance 
is 90, how large should our sample be? 


6.8 DETERMINATION OF SAMPLE SIZE 
FOR ESTIMATING PROPORTIONS 


The method of sample size determination when a population proportion is to be estimated 
is essentially the same as that described for estimating a population mean. We make use of 
the fact that one-half the desired interval, d, may be set equal to the product of the reliability 
coefficient and the standard error. 

Assuming that random sampling and conditions warranting approximate normality 
of the distribution of p leads to the following formula for n when sampling is with 
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replacement, when sampling is from an infinite population, or when the sampled popula- 
tion is large enough to make use of the finite population correction unnecessary, 


2 
© 
п= T (6.8.1) 
where q = 1 — p. 
If the finite population correction cannot be disregarded, the proper formula for n is 


Мара 


6.8.2 
d^(N — 1) + pq ( 


When М is large in comparison to n (that is, n/N < .05 the finite population 
correction may be ignored, and Equation 6.8.2 reduces to Equation 6.8.1. 


Estimating p As we see, both formulas require knowledge of p, the proportion in 
the population possessing the characteristic of interest. Since this is the parameter we are 
trying to estimate, it, obviously, will be unknown. One solution to this problem is to take 
a pilot sample and compute an estimate to be used in place of p in the formula for n. 
Sometimes an investigator will have some notion of an upper bound for p that can be 
used in the formula. For example, if it is desired to estimate the proportion of 
some population who have a certain disability, we may feel that the true proportion 
cannot be greater than, say, .30. We then substitute .30 for p in the formula for n. If it is 
impossible to come up with a better estimate, one may set p equal to .5 and solve for n. 
Since p = .5 in the formula yields the maximum value of п, this procedure will give a 
large enough sample for the desired reliability and interval width. It may, however, be 
larger than needed and result in a more expensive sample than if a better estimate of p 
had been available. This procedure should be used only if one is unable to arrive at a 
better estimate of p. 


EXAMPLE 6.8.1 


A survey is being planned to determine what proportion of families in a certain area are 
medically indigent. It is believed that the proportion cannot be greater than .35. A 95 
percent confidence interval is desired with d — .05. What size sample of families should be 
selected? 


Solution: If the finite population correction can be ignored, we have 


oe е 906) po 
(.05) 


The necessary sample size, then, is 350. B 
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EXERCISES 


6.8.1. 


6.8.2. 


6.8.3. 


6.8.4. 


An epidemiologist wishes to know what proportion of adults living in a large metropolitan area 
have subtype ayr hepatitis B virus. Determine the sample size that would be required to estimate 
the true proportion to within .03 with 95 percent confidence. In a similar metropolitan area the 
proportion of adults with the characteristic is reported to be .20. If data from another metropolitan 
area were not available and a pilot sample could not be drawn, what sample size would be 
required? 


A survey is planned to determine what proportion of the high-school students in a metropolitan 
school system have regularly smoked marijuana. If no estimate of p is available from previous 
studies, a pilot sample cannot be drawn, a confidence coefficient of .95 is desired, and d — .04 is to 
be used, determine the appropriate sample size. What sample size would be required if 99 percent 
confidence were desired? 


A hospital administrator wishes to know what proportion of discharged patients is unhappy with 
the care received during hospitalization. How large a sample should be drawn if we let d — .05, the 
confidence coefficient is .95, and no other information is available? How large should the sample 
be if p is approximated by .25? 


A health planning agency wishes to know, for a certain geographic region, what proportion of 
patients admitted to hospitals for the treatment of trauma die in the hospital. A 95 percent 
confidence interval is desired, the width of the interval must be .06, and the population proportion, 
from other evidence, is estimated to be .20. How large a sample is needed? 


6.9 CONFIDENCE INTERVAL FOR 
THE VARIANCE OF A NORMALLY 
DISTRIBUTED POPULATION 


Point Estimation of the Population Variance In previous sections it 
has been suggested that when a population variance is unknown, the sample variance 
may be used as an estimator. You may have wondered about the quality of this estimator. 
We have discussed only one criterion of quality—unbiasedness—so let us see if the 
sample variance is an unbiased estimator of the population variance. To be unbiased, 
the average value of the sample variance over all possible samples must be equal to 
the population variance. That is, the expression E(s?) = o? must hold. To see if this 
condition holds for a particular situation, let us refer to the example of constructing 
a sampling distribution given in Section 5.3. In Table 5.3.1 we have all possible 
samples of size 2 from the population consisting of the values 6, 8, 10, 12, and 14. 
It will be recalled that two measures of dispersion for this population were computed 
as follows: 


CES SSS E s ed 


2 2 
2 2208 m и) 8 and 52 = Dx — u) 10 
N N-1 


If we compute the sample variance s? = У) (x; — X) /(n — 1) for each of the possible 
samples shown in Table 5.3.1, we obtain the sample variances shown in Table 6.9.1. 
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TABLE 6.9.1 Variances Computed from Samples 
Shown in Table 5.3.1 


Second Draw 
6 8 10 12 14 
6 0 2 8 18 32 
8 0 2 8 18 
First Draw 10 8 2 0 2 8 
12 18 8 2 0 2 
14 32 18 8 2 0 


Sampling with Replacement If sampling is with replacement, the expected 
value of 5" is obtained by taking the mean of all sample variances in Table 6.9.1. When we 
do this, we have 


_ Уз; _0+2+...+2+0 200 


N" 25 25 E 


E(s?) 


and we see, for example, that when sampling is with replacement E(s?) — o?, where s? — 


Y (x; — x /(n — 1) and о? = Y (x; — и)? /N. 


Sampling Without Replacement If we consider the case where sampling is 
without replacement, the expected value of s? is obtained by taking the mean of all 
variances above (or below) the principal diagonal. That is, 
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ES! 
NC, 10 10 9 


E(s?) 


which, we see, is not equal to o?, but is equal to 5 = Y (x; — и) /(М — 1). 
These results are examples of general principles, as it can be shown that, in general, 


Е(52) =0? when sampling is with replacement 
E(s?) —S? when sampling is without replacement 


When N is large, N — 1 and N will be approximately equal and, consequently, o? 
and S? will be approximately equal. 

These results justify our use of s? = Y (x; — x) /(n — 1) when computing the 
sample variance. In passing, let us note that although s? is an unbiased estimator of 
0?, s is not an unbiased estimator of о. The bias, however, diminishes rapidly as n 


increases. 


Interval Estimation of a Population Variance With a point estimate 
available, it is logical to inquire about the construction of a confidence interval for a 
population variance. Whether we are successful in constructing a confidence interval for o? 
will depend on our ability to find an appropriate sampling distribution. 
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FIGURE 6.9.1 Chi-square distributions. 

(Source: Gerald van Belle, Lloyd D. Fisher, Patrick J. Heagerty, and Thomas Lumley, Biostatistics: A 
Methodology for the Health Sciences, 2nd Ed., (C) 2004 John Wiley & Sons, Inc. This material is reproduced 
with permission of John Wiley & Sons, Inc.) 


The Chi-Square Distribution Confidence intervals for o? are usually based on 
the sampling distribution of (n — 1)52 /02. If samples of size n are drawn from a normally 
distributed population, this quantity has a distribution known as the chi-square (x?) 
distribution with n — 1 degrees of freedom. As we will say more about this distribution in 
chapter 12, we only say here that it is the distribution that the quantity (n — 1)52 /02 follows 
and that it is useful in finding confidence intervals for o? when the assumption that the 
population is normally distributed holds true. 

Figure 6.9.1 shows chi-square distributions for several values of degrees of freedom. 
Percentiles of the chi-square distribution are given in Appendix Table F. The column 
headings give the values of x? to the left of which lies a proportion of the total area under 
the curve equal to the subscript of x?. The row labels are the degrees of freedom. 

To obtain a 100(1 — o) percent confidence interval for o?, we first obtain the 
100(1 — о) percent confidence interval for (п — 1)5?/0?. To do this, we select the values of 
X! from Appendix Table Е in such a way that a/2 is to the left of the smaller value and a/2 
is to the right of the larger value. In other words, the two values of x? are selected in such a 
way that o is divided equally between the W tails of the distribution. We may designate 
these two values of x? as x ар Y and Xi (a/2) respectively. The 100(1 — o) percent 
confidence interval for (n — 1)52 /02, then, is given by 


2 3 2 
Хар < — E Xi-(ap) 
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We now manipulate this expression in such a way that we obtain an expression with 
o? alone as the middle term. First, let us divide each term by (n — 1) 52 to get 


Xin 1 ХЇ (арэ) 
(n—1)? `о? `(п— 1)52 


If we take the reciprocal of this expression, we have 


(n — Ds? LR (n — 1)s? 
Xan Xi_(2/2) 


Note that the direction of the inequalities changed when we took the reciprocals. If we 
reverse the order of the terms, we have 


(n= 1)? ode (n — 1)? 


(6.9.1) 
ХІ (22) х 


which is the 100(1 — а) percent confidence interval for o°. If we take the square root of 


each term in Expression 6.9.1, we have the following 100(1 — o) percent confidence 
interval for c, the population standard deviation: 


(n — 1)s? re (n — 1)s? 


(6.9.2) 
Xi_(2/2) Xan 


EXAMPLE 6.9.1 


In a study of the effectiveness of a gluten-free diet in first-degree relatives of patients 
with type I diabetics, Hummel et al. (A-22) placed seven subjects on a gluten-free diet 
for 12 months. Prior to the diet, they took baseline measurements of several antibodies 
and autoantibodies, one of which was the diabetes related insulin autoantibody (IAA). 
The IAA levels were measured by radiobinding assay. The seven subjects had IAA 
units of 


9.7,12.3,11.2,5.1,24.8,14.8,17.7 


We wish to estimate from the data in this sample the variance of the IAA units in the 
population from which the sample was drawn and construct a 95 percent confidence 
interval for this estimate. 


Solution: The sample yielded a value of s? = 39.763. The degrees of freedom are 
n—1=6. The appropriate values of x? from Appendix Table Е are 
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Xi_(a/2) = 14.449 and Xn — 1.237. Our 95 percent confidence interval for 


o? 15 


6(39.763)  , | 6(39.763) 
14.449 1237 


16.512 < o? < 192.868 
The 95 percent confidence interval for o is 
4.063 < o < 13.888 


We are 95 percent confident that the parameters being estimated are within 
the specified limits, because we know that in the long run, in repeated 
sampling, 95 percent of intervals constructed as illustrated would include the 
respective parameters. и 


Some Precautions Although this method of constructing confidence intervals for 
о? is widely used, it is not without its drawbacks. First, the assumption of the normality of 
the population from which the sample is drawn is crucial, and results may be misleading if 
the assumption is ignored. 

Another difficulty with these intervals results from the fact that the estimator is not in 
the center of the confidence interval, as is the case with the confidence interval for jz. This 
is because the chi-square distribution, unlike the normal, is not symmetric. The practical 
implication of this is that the method for the construction of confidence intervals for o?, 
which has just been described, does not yield the shortest possible confidence intervals. 


Tate and Klett (12) give tables that may be used to overcome this difficulty. 


EXERCISES 


6.9.1. 


6.9.2. 


A study by Aizenberg et al. (A-23) examined the efficacy of sildenafil, a potent phosphodiesterase 
inhibitor, in the treatment of elderly men with erectile dysfunction induced by antidepressant 
treatment for major depressive disorder. The ages of the 10 enrollees in the study were 


74,81, 70, 70, 74, 77, 76, 70, 71, 72 


Assume that the subjects in this sample constitute a simple random sample drawn from a population 
of similar subjects. Construct a 95 percent confidence interval for the variance of the ages of subjects 
in the population. 


Borden et al. (A-24) performed experiments on cadaveric knees to test the effectiveness of several 
meniscal repair techniques. Specimens were loaded into a servohydraulic device and tension-loaded 
to failure. The biomechanical testing was performed by using a slow loading rate to simulate the 
stresses that the medial meniscus might be subjected to during early rehabilitation exercises and 
activities of daily living. One of the measures is the amount of displacement that occurs. Of the 12 
specimens receiving the vertical mattress suture and the FasT-FIX method, the displacement values 
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6.9.3. 


6.9.4. 


6.9.5. 


6.9.6. 


6.9.7. 


measured in millimeters are 16.9, 20.2, 20.1, 15.7, 13.9, 14.9, 18.0, 18.5, 9.2, 18.8, 22.8, 17.5. 
Construct a 90 percent confidence interval for the variance of the displacement in millimeters for a 
population of subjects receiving these repair techniques. 


Forced vital capacity determinations were made on 20 healthy adult males. The sample variance was 
1,000,000. Construct 90 percent confidence intervals for c? and c. 


In a study of myocardial transit times, appearance transit times were obtained on a sample of 
30 patients with coronary artery disease. The sample variance was found to be 1.03. Construct 
99 percent confidence intervals for o? and o. 


A sample of 25 physically and mentally healthy males participated in a sleep experiment in which the 
percentage of each participant's total sleeping time spent in a certain stage of sleep was recorded. The 
variance computed from the sample data was 2.25. Construct 95 percent confidence intervals for o? 
and о. 


Hemoglobin determinations were made on 16 animals exposed to a harmful chemical. The following 
observations were recorded: 15.6, 14.8, 14.4, 16.6, 13.8, 14.0, 17.3, 17.4, 18.6, 16.2, 14.7, 15.7, 16.4, 
13.9, 14.8, 17.5. Construct 95 percent confidence intervals for а? and c. 


Twenty air samples taken at the same site over a period of 6 months showed the following amounts of 
suspended particulate matter (micrograms per cubic meter of air): 


68 22 36 32 
42 24 28 38 
30 44 28 27 
28 43 45 50 
79 74 57 21 


Consider these measurements to be a random sample from a population of normally distributed 
measurements, and construct a 95 percent confidence interval for the population variance. 


6.10 CONFIDENCE INTERVAL 

FOR THE RATIO OF THE VARIANCES 
OF TWO NORMALLY DISTRIBUTED 
POPULATIONS 


Itis frequently of interest to compare two variances, and one way to do this is to form their 
ratio, 07/02. If two variances are equal, their ratio will be equal to 1. We usually will not 
know the variances of populations of interest, and, consequently, any comparisons we make 
will be based on sample variances. In other words, we may wish to estimate the ratio of two 
population variances. We learned in Section 6.4 that the valid use of the 1 distribution to 
construct a confidence interval for the difference between two population means requires 
that the population variances be equal. The use of the ratio of two population variances for 
determining equality of variances has been formalized into a statistical test. The distribu- 
tion of this test provides test values for determining if the ratio exceeds the value 1 to a large 
enough extent that we may conclude that the variances are not equal. The test is referred to 
as the F-max Test by Hartley (13) or the Variance Ratio Test by Zar (14). Many computer 
programs provide some formalized test of the equality of variances so that the assumption 
of equality of variances associated with many of the tests in the following chapters can be 


6.10 CONFIDENCE INTERVAL FOR THE RATIO OF THE VARIANCES OF TWO NORMALLY DISTRIBUTED POPULATIONS 199 


(10; го) 


rt (10; 50) 


(10; 10) 
(10; 4) 


1.0 


0.8 


0.6 


F(x) 


0.4 


0.2 


0.0 


0 0.5 1.0 1.5 2.0 2.5 3.0 3.5 4.0 


FIGURE 6.10.1 The F distribution for various degrees of freedom. 
(From Documenta Geigy, Scientific Tables, Seventh Edition, 1970. Courtesy of Ciba-Geigy Limited, Basel, 
Switzerland.) 


examined. If the confidence interval for the ratio of two population variances includes 1, we 
conclude that the two population variances may, in fact, be equal. Again, since this is a form 
of inference, we must rely on some sampling distribution, and this time the distribution of 
(51 / о?) / (55 / o2) is utilized provided certain assumptions are met. The assumptions are 
that s? and 52 are computed from independent samples of size n; and п» respectively, drawn 
from two normally distributed populations. We use 52 to designate the larger of the two 
sample variances. 


The F Distribution If the assumptions are met, (52/01) /(52/03) follows a 
distribution known as the F distribution. We defer a more complete discussion of this 
distribution until chapter 8, but note that this distribution depends on two-degrees-of- 
freedom values, one corresponding to the value of n; — 1 used in computing 52 апа ће 
other corresponding to the value of n; — 1 used in computing s. These are usually referred 
to as the numerator degrees of freedom and the denominator degrees of freedom. 
Figure 6.10.1 shows some F distributions for several numerator and denominator 
degrees-of-freedom combinations. Appendix Table G contains, for specified combinations 
of degrees of freedom and values of œ, F values to the right of which lies a/2 of the area 
under the curve of К 


A Confidence Interval for 02/02 То find the 100(1 — o) percent confidence 
interval for 02/02, we begin with the expression 


5 " о? 


Еър SUE TOU T 
2.122 
55/05 


< Fi-(a/2) 


where Fy/2 and F; (4/5?) are the values from the F table to the left and right of which, 
respectively, lies a/2 of the area under the curve. The middle term of this expression may 


be rewritten so that the entire expression is 
Е 2 


Е jeu p p) 
а/ 52 о? - (0/2) 
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If we divide through by я / 5, we have 


Fa) 02 F1.(aj2) 
я/ oy sis 


Taking the reciprocals of the three terms gives 


5/5 Oi. 81/55 


Fa) o? Fi-(a/2) 


and if we reverse the order, we have the following 100(1 — o) percent confidence interval 
242. 
for 01/05: 
2/02 X aaia 
51/55 от 51/55 


(6.10.1) 
Fi-a 02 Ез 


EXAMPLE 6.10.1 


Allen and Gross (A-25) examine toe flexors strength in subjects with plantar fasciitis (pain 
from heel spurs, or general heel pain), a common condition in patients with musculo- 
skeletal problems. Inflammation of the plantar fascia is often costly to treat and frustrating 
for both the patient and the clinician. One of the baseline measurements was the body mass 
index (BMI). For the 16 women in the study, the standard deviation for BMI was 8.1 and for 
four men in the study, the standard deviation was 5.9. We wish to construct a 95 percent 
confidence interval for the ratio of the variances of the two populations from which we 
presume these samples were drawn. 


Solution: We have the following information: 
n= 16 m=4 
52 = (8.1)? = 65.61 s2— (5.9)? = 34.81 
df, = numerator degrees of freedom = п — 1 = 15 


df, = denominator degrees of freedom = m — 1 = 3 
a = .05 
Е 025 = .24096 F975 = 14.25 


We аге now ready to obtain our 95 percent confidence interval for 
о? / о? by substituting appropriate values into Expression 6.10.1: 


65.61/34.81 | ої 65.61/34.81 
14.25 о? 24096 


o? 
1323 < — < 7.8221 
99 
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We give this interval the appropriate probabilistic and practical 


interpretations. 
Since the interval .1323 to 7.8221 includes 1, we are able to conclude 
that the two population variances may be equal. и 


Finding F, (,2, and F,/2 At this point we must make a cumbersome, but 
unavoidable, digression and explain how the values F 975 = 14.25 and F 025 = .24096 were 
obtained. The value of F 975 at the intersection of the column headed df, — 15 and the row 
labeled df, — 3 is 14.25. If we had a more extensive table of the F distribution, finding 
Е 025 would be no trouble; we would simply find F 025 as we found F 975. We would take the 
value at the intersection of the column headed 15 and the row headed 3. To include every 
possible percentile of F would make for a very lengthy table. Fortunately, however, there 
exists a relationship that enables us to compute the lower percentile values from our limited 
table. The relationship is as follows: 


1 
Fa afi dti = Wo (6.10.2) 
UUUT Friadrdf 


We proceed as follows. 

Interchange the numerator and denominator degrees of freedom and locate the 
appropriate value of F. For the problem at hand we locate 4.15, which is at the intersection 
of the column headed 3 and the row labeled 15. We now take the reciprocal of this value, 
1/4.15 — .24096. In summary, the lower confidence limit (LCL) and upper confidence 
limit (UCL) 02/02 are as follows: 


2 1 
LCL = a ———— 
55 Ка -а/ АГ» 


2 
5 

ССІ, = 3 Fi. (а/м, 
2 


Alternative procedures for making inferences about the equality of two variances 
when the sampled populations are not normally distributed may be found in the book by 
Daniel (15). 


Some Precautions Similar to the discussion in the previous section of construct- 
ing confidence intervals for o?, the assumption of normality of the populations from which 
the samples are drawn is crucial to obtaining correct intervals for the ratio of variances 
discussed in this section. Fortunately, most statistical computer programs provide alter- 
natives to the F-ratio, such as Levene's test, when the underlying distributions cannot be 
assumed to be normally distributed. Computationally, Levene's test uses a measure of 
distance from a sample median instead of a sample mean, hence removing the assumption 
of normality. 
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EXERCISES 


6.10.1. 


6.10.2. 


6.10.3. 


6.10.4. 


6.10.5. 


6.10.6. 


The purpose of a study by Moneim et al. (A-26) was to examine thumb amputations from team roping 
at rodeos. The researchers reviewed 16 cases of thumb amputations. Of these, 11 were complete 
amputations while five were incomplete. The ischemia time is the length of time that insufficient 
oxygen is supplied to the amputated thumb. The ischemia times (hours) for 11 subjects experiencing 
complete amputations were 


4.67, 10.5, 2.0, 3.18, 4.00, 3.5, 3.33, 5.32, 2.0, 4.25, 6.0 


For five victims of incomplete thumb amputation, the ischemia times were 


3.0, 10.25, 1.5, 5.22, 5.0 


Treat the two reported sets of data as sample data from the two populations as described. 
Construct a 95 percent confidence interval for the ratio of the two unknown population 
variances. 


The objective of a study by Horesh et al. (A-27) was to explore the hypothesis that some forms of 
suicidal behavior among adolescents are related to anger and impulsivity. The sample consisted of 
65 adolescents admitted to a university-affiliated adolescent psychiatric unit. The researchers used 
the Impulsiveness-Control Scale (ICS, A-28) where higher numbers indicate higher degrees of 
impulsiveness and scores can range from 0 to 45. The 33 subjects classified as suicidal had an ICS 
score standard deviation of 8.4 while the 32 nonsuicidal subjects had a standard deviation of 6.0. 
Assume that these two groups constitute independent simple random samples from two populations 
of similar subjects. Assume also that the ICS scores in these two populations are normally distributed. 
Find the 99 percent confidence interval for the ratio of the two population variances of scores on 
the ICS. 


Stroke index values were statistically analyzed for two samples of patients suffering from 
myocardial infarction. The sample variances were 12 and 10. There were 21 patients in each 
sample. Construct the 95 percent confidence interval for the ratio of the two population 
variances. 


Thirty-two adult asphasics seeking speech therapy were divided equally into two groups. Group 1 
received treatment 1, and group 2 received treatment 2. Statistical analysis of the treatment 
effectiveness scores yielded the following variances: 51 = 8,52 = 15. Construct the 90 percent 
confidence interval for 03/07. 


Sample variances were computed for the tidal volumes (milliliters) of two groups of patients suffering 
from atrial septal defect. The results and sample sizes were as follows: 


nı = 31, s$? = 35,000 
m = 4l, 52 — 20,000 


Construct the 95 percent confidence interval for the ratio of the two population variances. 


Glucose responses to oral glucose were recorded for 11 patients with Huntington's disease (group 1) 
and 13 control subjects (group 2). Statistical analysis of the results yielded the following sample 
variances: s? = 105, 53 = 148. Construct the 95 percent confidence interval for the ratio of the two 
population variances. 
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6.10.7. Measurements of gastric secretion of hydrochloric acid (milliequivalents per hour) in 16 normal 
subjects and 10 subjects with duodenal ulcer yielded the following results: 


Normal subjects: 6.3, 2.0, 2.3, 0.5, 1.9, 3.2, 4.1, 4.0, 6.2, 6.1, 3.5, 1.3, 1.7, 4.5, 6.3, 62 
Ulcer subjects: 13.7, 20.6, 15.9, 28.4, 29.4, 18.4, 21.1, 3.0, 26.2, 13.0 


Construct a 95 percent confidence interval for the ratio of the two population variances. What 
assumptions must be met for this procedure to be valid? 


6.11 SUMMARY 


This chapter is concerned with one of the major areas of statistical inference— estimation. 
Both point estimation and interval estimation are covered. The concepts and methods 
involved in the construction of confidence intervals are illustrated for the following 
parameters: means, the difference between two means, proportions, the difference between 
two proportions, variances, and the ratio of two variances. In addition, we learned in this 
chapter how to determine the sample size needed to estimate a population mean and a 
population proportion at specified levels of precision. 

We learned, also, in this chapter that interval estimates of population parameters are 
more desirable than point estimates because statements of confidence can be attached to 
interval estimates. 


SUMMARY OF FORMULAS FOR CHAPTER 6 


Formula 
Number Name Formula 
6.2.1 Expression of an interval estimator + (reliability coefficient) x 
estimate (standard error of the estimator) 
6.2.2 Interval estimate for ш X c Z(1-a/2)0% 
when o is known 
6.3.1 t-transformation "e xp 
s/yn 
6.3.2 Interval estimate for и. ED muU 
: X xfü-ap) = 
when o is unknown yn 
6.4.1 Interval estimate for the ERE, 
difference between two (Xx; — №2) + Z(1-a/2) 142 
A n n 
population means when ! 2 
с and o» are known 
6.4.2 Pooled variance estimate о (пі = 1)82 + (пә = 0s 
55 = 
P n +m = 2 
6.4.3 Standard error of estimate 32 
ED E 
S(x,—X3) аля 
т n» 


(Continued ) 
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6.4.4 


Interval estimate for the 
difference between two 
population means when 
с; is unknown 


6.4.5 


Cochran's correction for 
reliability coefficient 
when variances are not 
equal 


6.4.6 


6.5.1 


Interval estimate using 
Cochran's correction for t 


Interval estimate for a 
population proportion 


6.6.1 


6.7.1-6.7.3 


Interval estimate for the 
difference between two 
population proportions 


Sample size determination 
when sampling with 
replacement 


6.7.4-6.7.5 


6.8.1 


Sample size determination 
when sampling without 
replacement 


Sample size determination 
for proportions when 
sampling with 
replacement 


6.8.2 


Sample size determination 
for proportions when 
sampling without 
replacement 


6.9.1 


Interval estimate for o? 


6.9.2 


Interval estimate for o 


6.10.1 


Interval estimate for the 
ratio of two variances 


сі. 31/53 
Fi-a) 0% Fap 
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6.10.2 Relationship among F 1 
ratios Fadfidf = ¡A 
2 1—a.df df, 
Symbol * a = Type 1 error rate 
Key • x? = Chi-square distribution 


* d — error component of interval estimate 
* df — degrees of freedom 

* F — F-distribution 

* u = mean of population 

* n= sample size 

* p — proportion for population 
*а=(1-р) 

* р = estimated proportion for sample 
* o? — population variance 

* о = population standard deviation 

* о; = standard error 

* 5 = standard deviation of sample 

* 5, — pooled standard deviation 

• t = Student's t-transformation 

• г =Cochran’s correction to t 


• x = mean of sample 
* z= standard normal distribution 


REVIEW QUESTIONS AND EXERCISES 


Uo GRE ЧӘ. Os 


e 097 xc з: 


10. 


11. 
12. 


What is statistical inference? 

Why is estimation an important type of inference? 

What is a point estimate? 

Explain the meaning of unbiasedness. 

Define the following: 

(a) Reliability coefficient (b) Confidence coefficient (c) Precision 
(d) Standard error (e) Estimator (f) Margin of error 
Give the general formula for a confidence interval. 

State the probabilistic and practical interpretations of a confidence interval. 
Of what use is the central limit theorem in estimation? 

Describe the f distribution. 


What are the assumptions underlying the use of the 7 distribution in estimating a single population 
mean? 


What is the finite population correction? When can it be ignored? 


What are the assumptions underlying the use of the г distribution in estimating the difference between 
two population means? 
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13. 


14. 


15. 


16. 


17. 


18. 


19. 


20. 


21. 


Arterial blood gas analyses performed on a sample of 15 physically active adult males yielded the 
following resting PaO% values: 


75, 80, 80, 74, 84, 78, 89, 72, 83, 76, 75, 87, 78, 79, 88 


Compute the 95 percent confidence interval for the mean of the population. 


What proportion of asthma patients are allergic to house dust? In a sample of 140, 35 percent had 
positive skin reactions. Construct the 95 percent confidence interval for the population proportion. 


An industrial hygiene survey was conducted in a large metropolitan area. Of 70 manufacturing plants 
of a certain type visited, 21 received a “poor” rating with respect to absence of safety hazards. 
Construct a 95 percent confidence interval for the population proportion deserving a “poor” rating. 


Refer to the previous problem. How large a sample would be required to estimate the population 
proportion to within .05 with 95 percent confidence (.30 is the best available estimate of p): 
(a) If the finite population correction can be ignored? 


(b) If the finite population correction is not ignored and N = 1500? 


In a dental survey conducted by a county dental health team, 500 adults were asked to give the reason 
for their last visit to a dentist. Of the 220 who had less than a high-school education, 44 said they went 
for preventative reasons. Of the remaining 280, who had a high-school education or better, 150 stated 
that they went for preventative reasons. Construct a 95 percent confidence interval for the difference 
between the two population proportions. 


A breast cancer research team collected the following data on tumor size: 


Type of Tumor n X s 
A 21 3.85cm 1.95cm 
B 16 2.80cm 1.70cm 


Construct a 95 percent confidence interval for the difference between population means. 


A certain drug was found to be effective in the treatment of pulmonary disease in 180 of 200 cases 
treated. Construct the 90 percent confidence interval for the population proportion. 


Seventy patients with stasis ulcers of the leg were randomly divided into two equal groups. Each 
group received a different treatment for edema. At the end of the experiment, treatment effectiveness 
was measured in terms of reduction in leg volume as determined by water displacement. The means 
and standard deviations for the two groups were as follows: 


Group (Treatment) x 5 
А 95 сс 25 
В 125 сс 30 


Construct а 95 percent confidence interval for the difference in population means. 


What is the average serum bilirubin level of patients admitted to a hospital for treatment of hepatitis? 
A sample of 10 patients yielded the following results: 


20.5, 14.8, 21.3, 12.7, 15.2, 26.6, 23.4, 22.9, 15.7, 19.2 


Construct a 95 percent confidence interval for the population mean. 


22. 


23. 


24. 


25. 


26. 


27. 
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Determinations of saliva pH levels were made in two independent random samples of seventh-grade 
schoolchildren. Sample A children were caries-free while sample B children had a high incidence of 
caries. The results were as follows: 


А: 7.14, 7.11, 7.61, 7.98, 7.21, 7.16, 7.89 B: 7.36, 7.04, 7.19, 7.41, 7.10, 7.15, 7.36, 
7.24, 7.86, 7.47, 7.82, 7.37, 7.66, 7.62, 7.65 7.57, 7.64, 7.00, 7.25, 7.19 


Construct a 90 percent confidence interval for the difference between Ше population means. Assume 
that the population variances are equal. 


Drug A was prescribed for a random sample of 12 patients complaining of insomnia. An independent 
random sample of 16 patients with the same complaint received drug B. The number of hours of sleep 
experienced during the second night after treatment began were as follows: 


А: 3.5, 5.7, 3.4, 6.9, 17.8, 3.8, 3.0, 6.4, 6.8, 3.6, 6.9, 5.7 
B: 4.5, 11.7, 10.8, 4.5, 6.3, 3.8, 6.2, 6.6, 7.1, 6.4, 4.5, 5.1, 
3.2, 4.7, 4.5, 3.0 


Construct a 95 percent confidence interval for the difference between the population means. Assume 
that the population variances are equal. 


The objective of a study by Crane et al. (A-29) was to examine the efficacy, safety, and maternal 
satisfaction of (a) oral misoprostol and (b) intravenous oxytocin for labor induction in women with 
premature rupture of membranes at term. Researchers randomly assigned women to the two 
treatments. For the 52 women who received oral misoprostol, the mean time in minutes to active 
labor was 358 minutes with a standard deviation of 308 minutes. For the 53 women taking oxytocin, 
the mean time was 483 minutes with a standard deviation of 144 minutes. Construct a 99 percent 
confidence interval for the difference in mean time to active labor for these two different medications. 
What assumptions must be made about the reported data? Describe the population about which an 
inference can be made. 


Over a 2-year period, 34 European women with previous gestational diabetes were retrospectively 
recruited from West London antenatal databases for a study conducted by Kousta et al. (A-30). One of 
the measurements for these women was the fasting nonesterified fatty acids concentration (NEFA) 
measured in jzmol/L. In the sample of 34 women, the mean NEFA level was 435 with a sample 
standard deviation of 215.0. Construct a 95 percent confidence interval for the mean fasting NEFA 
level for a population of women with gestational diabetes. State all necessary assumptions about the 
reported data and subjects. 


Scheid et al. (A-31) questioned 387 women receiving free bone mineral density screening. The 
questions focused on past smoking history. Subjects undergoing hormone replacement therapy 
(HRT), and subjects not undergoing HRT, were asked if they had ever been a regular smoker. In the 
HRT group, 29.3 percent of 220 women stated that they were at some point in their life a regular 
smoker. In the non-HRT group, 17.3 percent of 106 women responded positively to being at some 
point in their life a regular smoker. (Sixty-one women chose not to answer the question.) Construct a 
95 percent confidence interval for the difference in smoking percentages for the two populations of 
women represented by the subjects in the study. What assumptions about the data are necessary? 


The purpose of a study by Elliott et al. (A-32) was to assess the prevalence of vitamin D deficiency in 
women living in nursing homes. The sample consisted of 39 women in a 120-bed skilled nursing 
facility. Women older than 65 years of age who were long-term residents were invited to participate if 
they had no diagnosis of terminal cancer or metastatic disease. In the sample, 23 women had 25- 
hydroxyvitamin D levels of 20 ng/ml or less. Construct a 95 percent confidence interval for the 
percent of women with vitamin D deficiency in the population presumed to be represented by this 
sample. 
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28. In a study of the role of dietary fats in the etiology of ischemic heart disease the subjects were 
60 males between 40 and 60 years of age who had recently had a myocardial infarction and 
50 apparently healthy males from the same age group and social class. One variable of interest in the 
study was the proportion of linoleic acid (L.A.) in the subjects" plasma triglyceride fatty acids. The 
data on this variable were as follows: 


Subjects with Myocardial Infarction 


Subject L.A. Subject L.A. Subject L.A. Subject L.A. 
1 18.0 2 17.6 3 9.6 4 5.5 
5 16.8 6 12.9 7 14.0 8 8.0 
9 8.9 10 15.0 11 9.3 12 5.8 

13 8.3 14 4.8 15 6.9 16 18.3 
17 24.0 18 16.8 19 12.1 20 12.9 
21 16.9 22 15.1 23 6.1 24 16.6 
25 8.7 26 15.6 27 12.3 28 14.9 
29 16.9 30 5.7 31 14.3 32 14.1 
33 14.1 34 15.1 35 10.6 36 13.6 
37 16.4 38 10.7 39 18.1 40 14.3 
41 6.9 42 6.5 43 17.7 44 13.4 
45 15.6 46 10.9 47 13.0 48 10.6 
49 7.9 50 2.8 51 15.2 52 22.3 
53 9.7 54 15.2 55 10.1 56 11.5 
57 15.4 58 17.8 59 12.6 60 7.2 


Healthy Subjects 


Subject L.A. Subject L.A. Subject L.A. Subject L.A. 
1 17.1 2 22.9 3 10.4 4 30.9 
5 32.7 6 9.1 7 20.1 8 19.2 
9 18.9 10 20.3 11 35.6 12 17.2 

13 5.8 14 15.2 15 22.2 16 21.2 
17 19.3 18 25.6 19 42.4 20 5.9 
21 29.6 22 18.2 23 21:7 24 29.7 
25 12.4 26 15.4 27 21.7 28 19.3 
29 16.4 30 23.1 31 19.0 32 12.9 
33 18.5 34 27.6 35 25.0 36 20.0 
37 51.7 38 20.5 39 25.9 40 24.6 
41 22.4 42 27.1 43 11.1 44 32.7 
45 132 46 22.1 47 13.5 48 5.3 
49 29.0 50 20.2 


Construct the 95 percent confidence interval for the difference between population means. What do 
these data suggest about the levels of linoleic acid in the two sampled populations? 


29. The purpose of a study by Tahmassebi and Curzon (A-33) was to compare the mean salivary flow rate 
among subjects with cerebral palsy and among subjects in a control group. Each group had 
10 subjects. The following table gives the mean flow rate in ml/minute as well as the standard error. 


30. 


31. 


32. 


33. 


34. 


35. 


36. 
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Group Sample Size Mean ml/minute Standard Error 
Cerebral palsy 10 0.220 0.0582 
Control 10 0.334 0.1641 


source: J. Е. Tahmassebi and M. E. J. Curzon, “The Cause of Drooling in Children with 
Cerebral Palsy—Hypersalivation or Swallowing Defect?" International Journal of Paediatric 
Dentistry, 13 (2003), 106-111. 


Construct the 90 percent confidence interval for the difference in mean salivary flow rate for the two 
populations of subjects represented by the sample data. State the assumptions necessary for this to be 
a valid confidence interval. 


Culligan et al. (A-34) compared the long-term results of two treatments: (a) a modified Burch 
procedure, and (b) a sling procedure for stress incontinence with a low-pressure urethra. Thirty-six 
women took part in the study with 19 in the Burch treatment group and 17 in the sling procedure 
treatment group. One of the outcome measures at three months post-surgery was maximum urethral 
closure pressure (cm H5O). In the Burch group the mean and standard deviation were 16.4 and 8.2 cm, 
respectively. In the sling group, the mean and standard deviation were 39.8 and 23.0, respectively. 
Construct the 99 percent confidence interval for the difference in mean maximum urethral closure 
pressure for the two populations represented by these subjects. State all necessary assumptions. 


In general, narrow confidence intervals are preferred over wide ones. We can make an interval narrow 
by using a small confidence coefficient. For a given set of other conditions, what happens to the level 
of confidence when we use a small confidence coefficient? What would happen to the interval width 
and the level of confidence if we were to use a confidence coefficient of zero? 


In general, a high level of confidence is preferred over a low level of confidence. For a given set of 
other conditions, suppose we set our level of confidence at 100 percent. What would be the effect of 
such a choice on the width of the interval? 


The subjects of a study by Borland et al. (A-35) were children in acute pain. Thirty-two children who 
presented at an emergency room were enrolled in the study. Each child used the visual analogue scale 
to rate pain on a scale from 0 to 100 mm. The mean pain score was 61.3 mm with a 95 percent 
confidence interval of 53.2 mm-69.4 mm. Which would be the appropriate reliability factor for the 
interval, z or І? Justify your choice. What is the precision of the estimate? The margin of error? 


Does delirium increase hospital stay? That was the research question investigated by McCusker et al. 
(A-36). The researchers sampled 204 patients with prevalent delirium and 118 without delirium. The 
conclusion of the study was that patients with prevalent delirium did not have a higher mean length of 
stay compared to those without delirium. What was the target population? The sampled population? 


Assessing driving self-restriction in relation to vision performance was the objective of a study by West 
et al. (A-37). The researchers studied 629 current drivers ages 55 and older for 2 years. The variables of 
interest were driving behavior, health, physical function, and vision function. The subjects were part of a 
larger vision study at the Smith-Kettlewell Eye Research Institute. A conclusion of the study was that 
older adults with early changes in spatial vision function and depth perception appear to recognize their 
limitations and restrict their driving. What was the target population? The sampled population? 


In a pilot study conducted by Ayouba et al. (A-38), researchers studied 123 children born of HIV-1- 
infected mothers in Yaoundé, Cameroon. Counseled and consenting pregnant women were given a 
single dose of nevirapine at the onset of labor. Babies were given a syrup containing nevirapine within 
the first 72 hours of life. The researchers found that 87 percent of the children were considered not 
infected at 6-8 weeks of age. What is the target population? What is the sampled population? 
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37. Refer to Exercise 2.3.11. Construct a 95 percent confidence interval for the population mean S/R 
ratio. Should you use t or z as the reliability coefficient? Why? Describe the population about which 
inferences based on this study may be made. 


38. Refer to Exercise 2.3.12. Construct a 90 percent confidence interval for the population mean height. 
Should you use f or z as the reliability coefficient? Why? Describe the population about which 
inferences based on this study may be made. 


Exercises for Use with Large Data Sets Available on the Following Website: 
www.wiley.com/college/daniel 


1. 


REFERENCES 


Refer to North Carolina Birth Registry Data NCBIRTH800 with 800 observations (see Large 
Data Exercise 1 in Chapter 2). Calculate 95 percent confidence intervals for the following: 


(a) the percentage of male children 

(b) the mean age of a mother giving birth 

(c) the mean weight gained during pregnancy 

(d) the percentage of mothers admitting to smoking during pregnancy 

(e) the difference in the average weight gained between smoking and nonsmoking mothers 

(f) the difference in the average birth weight in grams between married and nonmarried mothers 

(g) the difference in the percentage of low birth weight babies between married and nonmarried 
mothers 

Refer to the serum cholesterol levels for 1000 subjects (CHOLEST). Select a simple random 

sample of size 15 from this population and construct a 95 percent confidence interval for the 

population mean. Compare your results with those of your classmates. What assumptions are 

necessary for your estimation procedure to be valid? 

Refer to the serum cholesterol levels for 1000 subjects (CHOLEST). Select a simple random 

sample of size 50 from the population and construct a 95 percent confidence interval for the 

proportion of subjects in the population who have readings greater than 225. Compare your 

results with those of your classmates. 

Refer to the weights of 1200 babies born in a community hospital (BABY WGTS). Draw a simple 

random sample of size 20 from this population and construct a 95 percent confidence interval for 

the population mean. Compare your results with those of your classmates. What assumptions are 

necessary for your estimation procedure to be valid? 

Refer to the weights of 1200 babies born in a community hospital (BABY WGTS). Draw a simple 

random sample of size 35 from the population and construct a 95 percent confidence interval for 

the population mean. Compare this interval with the one constructed in Exercise 4. 

Refer to the heights of 1000 twelve-year-old boys (BOY HGTS). Select a simple random sample 

of size 15 from this population and construct a 99 percent confidence interval for the population 

mean. What assumptions are necessary for this procedure to be valid? 

Refer to the heights of 1000 twelve-year-old boys (BOY HGTS). Select a simple random sample 

of size 35 from the population and construct a 99 percent confidence interval for the population 

mean. Compare this interval with the one constructed in Exercise 5. 
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HYPOTHESIS TESTING 


CHAPTER OVERVIEW 


TOPICS 


This chapter covers hypothesis testing, the second of two general areas of 
statistical inference. Hypothesis testing is a topic with which you as a studentare 
likely to have some familiarity. Interval estimation, discussed in the preceding 
chapter, and hypothesis testing are based on similar concepts. In fact, confi- 
dence intervals may be used to arrive at the same conclusions that are reached 
through the use of hypothesis tests. This chapter provides a format, followed 
throughout the remainder of this book, for conducting a hypothesis test. 


7.1 INTRODUCTION 
7.2 HYPOTHESIS TESTING: A SINGLE POPULATION MEAN 


7.3 HYPOTHESIS TESTING: THE DIFFERENCE BETWEEN TWO POPULATION 
MEANS 
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After studying this chapter, the student will 


1. understand how to correctly state a null and alternative hypothesis and carry out a 
structured hypothesis test. 


2. understand the concepts of type І error, type Il error, and the power of a test. 


3. be able to calculate and interpret z, t, F, and chi-square test statistics for making 
statistical inferences. 


4. understand how to calculate and interpret p values. 
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7.1 INTRODUCTION 


One type of statistical inference, estimation, is discussed in the preceding chapter. The 
other type, hypothesis testing, is the subject of this chapter. As is true with estimation, 
the purpose of hypothesis testing is to aid the clinician, researcher, or administrator in 
reaching a conclusion concerning a population by examining a sample from that 
population. Estimation and hypothesis testing are not as different as they are made to 
appear by the fact that most textbooks devote a separate chapter to each. As we will explain 
later, one may use confidence intervals to arrive at the same conclusions that are reached by 
using the hypothesis testing procedures discussed in this chapter. 


Basic Concepts In this section some of the basic concepts essential to an under- 
standing of hypothesis testing are presented. The specific details of particular tests will be 
given in succeeding sections. 


DEFINITION 


A hypothesis may be defined simply as a statement about one or more 
populations. 


The hypothesis is frequently concerned with the parameters of the populations 
about which the statement is made. A hospital administrator may hypothesize that the 
average length of stay of patients admitted to the hospital is 5 days; a public health nurse 
may hypothesize that a particular educational program will result in improved com- 
munication between nurse and patient; a physician may hypothesize that a certain drug 
will be effective in 90 percent of the cases for which it is used. By means of hypothesis 
testing one determines whether or not such statements are compatible with the available 
data. 


Types of Hypotheses Researchers are concerned with two types of hypotheses— 
research hypotheses and statistical hypotheses. 


DEFINITION 


The research hypothesis is the conjecture or supposition that motivates 
the research. 


It may be the result of years of observation on the part of the researcher. A public 
health nurse, for example, may have noted that certain clients responded more readily to a 
particular type of health education program. A physician may recall numerous instances in 
which certain combinations of therapeutic measures were more effective than any one of 
them alone. Research projects often result from the desire of such health practitioners to 
determine whether or not their theories or suspicions can be supported when subjected to 
the rigors of scientific investigation. 


216 


CHAPTER 7 HYPOTHESIS TESTING 
Research hypotheses lead directly to statistical hypotheses. 


DEFINITION 


Statistical hypotheses are hypotheses that are stated in such a way that 
they may be evaluated by appropriate statistical techniques. 


In this book the hypotheses that we will focus on are statistical hypotheses. We will 
assume that the research hypotheses for the examples and exercises have already been 
considered. 


Hypothesis Testing Steps For convenience, hypothesis testing will be pre- 
sented as a ten-step procedure. There is nothing magical or sacred about this particular 
format. It merely breaks the process down into a logical sequence of actions and decisions. 


1. Data. The nature of the data that form the basis of the testing procedures must be 
understood, since this determines the particular test to be employed. Whether the 
data consist of counts or measurements, for example, must be determined. 


2. Assumptions. As we learned in the chapter on estimation, different assumptions 
lead to modifications of confidence intervals. The same is true in hypothesis 
testing: A general procedure is modified depending on the assumptions. In fact, 
the same assumptions that are of importance in estimation are important in 
hypothesis testing. We have seen that these include assumptions about the 
normality of the population distribution, equality of variances, and independence 
of samples. 


3. Hypotheses. There are two statistical hypotheses involved in hypothesis testing, and 
these should be stated explicitly. The null hypothesis is the hypothesis to be tested. It 
is designated by the symbol Но. The null hypothesis is sometimes referred to as a 
hypothesis of no difference, since it is a statement of agreement with (or no difference 
from) conditions presumed to be true in the population of interest. In general, the null 
hypothesis is set up for the express purpose of being discredited. Consequently, the 
complement of the conclusion that the researcher is seeking to reach becomes the 
statement of the null hypothesis. In the testing process the null hypothesis either is 
rejected or is not rejected. If the null hypothesis is not rejected, we will say that the 
data on which the test is based do not provide sufficient evidence to cause rejection. If 
the testing procedure leads to rejection, we will say that the data at hand are not 
compatible with the null hypothesis, but are supportive of some other hypothesis. The 
alternative hypothesis is a statement of what we will believe is true if our sample data 
cause us to reject the null hypothesis. Usually the alternative hypothesis and the 
research hypothesis are the same, and in fact the two terms are used interchangeably. 
We shall designate the alternative hypothesis by the symbol Ha. 


Rules for Stating Statistical Hypotheses When hypotheses are of the 
type considered in this chapter an indication of equality (either =, <, or >) must 
appear in the null hypothesis. Suppose, for example, that we want to answer the 
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question: Can we conclude that a certain population mean is not 50? The null 
hypothesis is 


Но: и = 50 


and the alternative is 


НА: u #50 


Suppose we want to know if we can conclude that the population mean is greater than 
50. Our hypotheses are 


Но: u < 50 Ha: и > 50 


If we want to know if we can conclude that the population mean is less than 50, the 
hypotheses are 


Ho: u > 50 Ha: и < 50 


In summary, we may state the following rules of thumb for deciding what 
statement goes in the null hypothesis and what statement goes in the alternative 
hypothesis: 


(a) What you hope or expect to be able to conclude as a result of the test usually should 
be placed in the alternative hypothesis. 


(b) The null hypothesis should contain a statement of equality, either =, <,or >. 
(c) The null hypothesis is the hypothesis that is tested. 


(d) The null and alternative hypotheses are complementary. That is, the two together 
exhaust all possibilities regarding the value that the hypothesized parameter can 
assume. 


A Precaution І should be pointed out that neither hypothesis testing nor statistical 
inference, in general, leads to the proof of a hypothesis; it merely indicates whether the 
hypothesis is supported or is not supported by the available data. When we fail to reject a 
null hypothesis, therefore, we do not say that it is true, but that it may be true. When we 
speak of accepting a null hypothesis, we have this limitation in mind and do not wish to 
convey the idea that accepting implies proof. 


4. Test statistic. The test statistic is some statistic that may be computed from the data 
of the sample. As a rule, there are many possible values that the test statistic may 
assume, the particular value observed depending on the particular sample drawn. As 
we will see, the test statistic serves as a decision maker, since the decision to reject or 
not to reject the null hypothesis depends on the magnitude of the test statistic. 
An example of a test statistic is the quantity 


| X — Ho 


EZ 


z (7.1.1) 
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where ¡uy is a hypothesized value of a population mean. This test statistic is related to 
the statistic 


xp 


оўуп 


z (1.1.2) 


with which we are already familiar. 


General Formula for Test Statistic The following is a general formula for 
a test statistic that will be applicable in many of the hypothesis tests discussed in this 
book: 


me relevant statistic — hypothesized parameter 
test statistic — 


standard error of the relevant statistic 


In Equation 7.1.1, x is the relevant statistic, шо is the hypothesized parameter, and с / /п is 
the standard error of x, the relevant statistic. 


5. Distribution of test statistic. It has been pointed out that the key to statistical 
inference is the sampling distribution. We are reminded of this again when it becomes 
necessary to specify the probability distribution of the test statistic. The distribution 
of the test statistic 


| X — Шо 


_ ofyn 


for example, follows the standard normal distribution if the null hypothesis is true 
and the assumptions are met. 


< 


6. Decision rule. АП possible values that the test statistic can assume are points on the 
horizontal axis of the graph of the distribution of the test statistic and are divided into 
two groups; one group constitutes what is known as the rejection region and the other 
group makes up the nonrejection region. The values of the test statistic forming the 
rejection region are those values that are less likely to occur if the null hypothesis is 
true, while the values making up the acceptance region are more likely to occur if 
the null hypothesis is true. The decision rule tells us to reject the null hypothesis if the 
value of the test statistic that we compute from our sample is one of the values in the 
rejection region and to not reject the null hypothesis if the computed value of the test 
statistic is one of the values in the nonrejection region. 


Significance Level The decision as to which values go into the rejection region 
and which ones go into the nonrejection region is made on the basis of the desired level of 
significance, designated by o. The term level of significance reflects the fact that hypothesis 
tests are sometimes called significance tests, and a computed value of the test statistic that 
falls in the rejection region is said to be significant. The level of significance, o, specifies 
the area under the curve of the distribution of the test statistic that is above the values on the 
horizontal axis constituting the rejection region. 
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DEFINITION 


The level of significance « is a probability and, in fact, is the probability 
of rejecting a true null hypothesis. 


Since to reject a true null hypothesis would constitute an error, it seems only 
reasonable that we should make the probability of rejecting a true null hypothesis small 
and, in fact, that is what is done. We select a small value of o in order to make the 
probability of rejecting a true null hypothesis small. The more frequently encountered 
values of а are .01, .05, and .10. 


Types of Errors The error committed when a true null hypothesis is rejected is 
called the type I error. The type П erroris the error committed when a false null hypothesis 
is not rejected. The probability of committing a type II error is designated by f. 

Whenever we reject a null hypothesis there is always the concomitant risk of 
committing a type I error, rejecting a true null hypothesis. Whenever we fail to reject a null 
hypothesis the risk of failing to reject a false null hypothesis is always present. We make a 
small, but we generally exercise no control over В, although we know that in most practical 
situations it is larger than o. 

We never know whether we have committed one of these errors when we reject or fail 
to reject a null hypothesis, since the true state of affairs is unknown. If the testing procedure 
leads to rejection of the null hypothesis, we can take comfort from the fact that we made a 
small and, therefore, the probability of committing a type I error was small. If we fail to 
reject the null hypothesis, we do not know the concurrent risk of committing a type II error, 
since В is usually unknown but, as has been pointed out, we do know that, in most practical 
situations, it is larger than o. 

Figure 7.1.1 shows for various conditions of a hypothesis test the possible actions 
that an investigator may take and the conditions under which each of the two types of error 
will be made. The table shown in this figure is an example of what is generally referred to as 
a confusion matrix. 


7. Calculation of test statistic. From the data contained in the sample we compute a 
value of the test statistic and compare it with the rejection and nonrejection regions 
that have already been specified. 

8. Statistical decision. The statistical decision consists of rejecting or of not rejecting 
the null hypothesis. It is rejected if the computed value of the test statistic falls in the 


Condition of Null Hypothesis 


True Fase 
Fail to Correct action Typell error 
Possible rgect Ho 
Action дее Ho Typel error Correct action 


FIGURE 7.1.1 Conditions under which type І and type ll errors may be committed. 
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rejection region, and it is not rejected if the computed value of the test statistic falls in 
the nonrejection region. 


9. Conclusion. If Но is rejected, we conclude that Ha is true. If Но is not rejected, we 
conclude that Но may be true. 


10. p values. The p value is a number that tells us how unusual our sample results are, 
given that the null hypothesis is true. A p value indicating that the sample results are 
not likely to have occurred, if the null hypothesis is true, provides justification for 
doubting the truth of the null hypothesis. 


DEFINITION 


A p value is the probability that the computed value of a test statistic is 

at least as extreme as a specified value of the test statistic when the null 
hypothesis is true. Thus, the p value is the smallest value of « for which we 
can reject a null hypothesis. 


We emphasize that when the null hypothesis is not rejected one should not say that 
the null hypothesis is accepted. We should say that the null hypothesis is “not rejected." We 
avoid using the word "accept" in this case because we may have committed a type II error. 
Since, frequently, the probability of committing a type II error can be quite high, we do not 
wish to commit ourselves to accepting the null hypothesis. 

Figure 7.1.2 is a flowchart of the steps that we follow when we perform a hypothesis 
test. 


Purpose of Hypothesis Testing The purpose of hypothesis testing is to assist 
administrators and clinicians in making decisions. The administrative or clinical decision 
usually depends on the statistical decision. If the null hypothesis is rejected, the adminis- 
trative or clinical decision usually reflects this, in that the decision is compatible with the 
alternative hypothesis. The reverse is usually true if the null hypothesis is not rejected. The 
administrative or clinical decision, however, may take other forms, such as a decision to 
gather more data. 

We also emphasize that the hypothesis testing procedures highlighted in the 
remainder of this chapter generally examine the case of normally distributed data or 
cases where the procedures are appropriate because the central limit theorem applies. In 
practice, it is not uncommon for samples to be small relative to the size of the population, 
or to have samples that are highly skewed, and hence the assumption of normality is 
violated. Methods to handle this situation, that is distribution-free or nonparametric 
methods, are examined in detail in Chapter 13. Most computer packages include an 
analytical procedure (for example, the Shapiro-Wilk or Anderson-Darling test) for 
testing normality. It is important that such tests are carried out prior to analysis of 
data. Further, when testing two samples, there is an implicit assumption that the 
variances are equal. Tests for this assumption are provided in Section 7.8. Finally, it 
should be noted that hypothesis tests, just like confidence intervals, are relatively 
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Evaluate 
data 


Review 
assumptions 


State 
hypotheses 


Select 
test 
statistics 


Determine 
distribution 
of test 
statistics 


State 
decision 
rule 


Calculate 
test 
statistics 


Make 
statistical 
decision 


Do not 
reject Но 


Reject Ho 


Conclude Ну 
may be true 


Conclude H, 
is true 


FIGURE 7.1.2 Steps іп the hypothesis testing procedure. 


sensitive to the size of the samples being tested, and caution should be taken when 
interpreting results involving very small sample sizes. 

We must emphasize at this point, however, that the outcome of the statistical test is 
only one piece of evidence that influences the administrative or clinical decision. The 
statistical decision should not be interpreted as definitive but should be considered along 
with all the other relevant information available to the experimenter. 

With these general comments as background, we now discuss specific hypothesis 
tests. 
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7.2 HYPOTHESIS TESTING: 
A SINGLE POPULATION MEAN 


In this section we consider the testing of a hypothesis about a population mean under 
three different conditions: (1) when sampling is from a normally distributed population 
of values with known variance; (2) when sampling is from a normally distributed 
population with unknown variance, and (3) when sampling is from a population that is 
not normally distributed. Although the theory for conditions 1 and 2 depends on 
normally distributed populations, it is common practice to make use of the theory 
when relevant populations are only approximately normally distributed. This is satis- 
factory as long as the departure from normality is not drastic. When sampling is from a 
normally distributed population and the population variance is known, the test statistic 
for testing Ho: и = My is 


xp 
= —— 7.2.1 
mem m ( ) 
which, when Но is true, is distributed as the standard normal. Examples 7.2.1 and 7.2.2 
illustrate hypothesis testing under these conditions. 


Sampling from Normally Distributed Populations: Population 
Variances Known As we did in Chapter 6, we again emphasize that situations in 
which the variable of interest is normally distributed with a known variance are rare. The 
following example, however, will serve to illustrate the procedure. 


EXAMPLE 7.2.1 


Researchers are interested in the mean age of a certain population. Let us say that they are 
asking the following question: Can we conclude that the mean age of this population is 
different from 30 years? 


Solution: Based on our knowledge of hypothesis testing, we reply that they can 
conclude that the mean age is different from 30 if they can reject the null 
hypothesis that the mean is equal to 30. Let us use the ten-step hypothesis 
testing procedure given in the previous section to help the researchers reach a 
conclusion. 


1. Data. The data available to the researchers are the ages of a simple 
random sample of 10 individuals drawn from the population of interest. 
From this sample a mean of x — 27 has been computed. 

2. Assumptions. It is assumed that the sample comes from a population 
whose ages are approximately normally distributed. Let us also assume 
that the population has a known variance of o? — 20. 


3. Hypotheses. The hypothesis to be tested, or null hypothesis, is that the 
mean age of the population is equal to 30. The alternative hypothesis is 
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that the mean age of the population is not equal to 30. Note that we are 
identifying with the alternative hypothesis the conclusion the researchers 
wish to reach, so that if the data permit rejection of the null hypothesis, the 
researchers” conclusion will carry more weight, since the accompanying 
probability of rejecting a true null hypothesis will be small. We will make 
sure of this by assigning a small value to o, the probability of committing 
a type І error. We may present the relevant hypotheses in compact form as 
follows: 


Но: и = 30 
НА: u + 30 


. Test statistic. Since we are testing a hypothesis about a population 
mean, since we assume that the population is normally distributed, and 
since the population variance is known, our test statistic is given by 
Equation 7.2.1. 


. Distribution of test statistic. Based on our knowledge of sampling 
distributions and the normal distribution, we know that the test statistic 
is normally distributed with a mean of 0 and a variance of 1, if Но is 
true. There are many possible values of the test statistic that the 
present situation can generate; one for every possible sample of size 10 
that can be drawn from the population. Since we draw only one 
sample, we have only one of these possible values on which to base a 
decision. 


. Decision rule. The decision rule tells us to reject Но if the computed 
value of the test statistic falls in the rejection region and to fail to reject Но 
if it falls in the nonrejection region. We must now specify the rejection and 
nonrejection regions. We can begin by asking ourselves what magnitude 
of values of the test statistic will cause rejection of Но. If the null 
hypothesis is false, it may be so either because the population mean is 
less than 30 or because the population mean is greater than 30. Therefore, 
either sufficiently small values or sufficiently large values of the test 
statistic will cause rejection of the null hypothesis. We want these extreme 
values to constitute the rejection region. How extreme must a possible 
value of the test statistic be to qualify for the rejection region? The answer 
depends on the significance level we choose, that is, the size of the 
probability of committing a type I error. Let us say that we want the 
probability of rejecting a true null hypothesis to be о = .05. Since our 
rejection region is to consist of two parts, sufficiently small values and 
sufficiently large values of the test statistic, part of a will have to be 
associated with the large values and part with the small values. It seems 
reasonable that we should divide o equally and let a/2 = .025 be 
associated with small values and 0/2 = .025 be associated with large 
values. 
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Critical Value of Test Statistic 


What value of the test statistic is so large that, when the null hypothesis is true, the 
probability of obtaining a value this large or larger is .025? In other words, what is the value 
of z to the right of which lies .025 of the area under the standard normal distribution? The 
value of z to the right of which lies .025 of the area is the same value that has .975 of the area 
between it and —oo. We look in the body of Appendix Table D until we find .975 or its 
closest value and read the corresponding marginal entries to obtain our z value. In the 
present example the value of zis 1.96. Similar reasoning will lead us to find — 1.96 as the value 
of the test statistic so small that when the null hypothesis is true, the probability of obtaining 
a value this small or smaller is .025. Our rejection region, then, consists of all values of 
the test statistic equal to or greater than 1.96 and less than or equal to —1.96. The 
nonrejection region consists of all values in between. We may state the decision rule for 
this test as follows: reject Ho if the computed value of the test statistic is either > 1.96 or 
< —1.96. Otherwise, do not reject Но. The rejection and nonrejection regions are shown 
in Figure 7.2.1. The values of the test statistic that separate the rejection and nonrejection 
regions are called critical values of the test statistic, and the rejection region is 
sometimes referred to as the critical region. 

The decision rule tells us to compute a value of the test statistic from the data of 
our sample and to reject Но if we get a value that is either equal to or greater than 1.96 
or equal to or less than —1.96 and to fail to reject Не if we get any other value. The 
value of o and, hence, the decision rule should be decided on before gathering the data. 
This prevents our being accused of allowing the sample results to influence our choice 
of o. This condition of objectivity is highly desirable and should be preserved in 
all tests. 


7. Calculation of test statistic. From our sample we compute 
_ 27—30 —3 


~ \/20/10 14142 — 


8. Statistical decision. Abiding by the decision rule, we are able to 
reject the null hypothesis since —2.12 is in the rejection region. We 


2.12 


—1.96 0 1.96 2 
w A Y | Y 
Rejection region Nonrejection Rejection region 
region 


FIGURE 7.2.1 Rejection and nonrejection regions for Example 7.2.1. 
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can say that the computed value of the test statistic is significant at 
the .05 level. 


9. Conclusion. We conclude that ш is not equal to 30 and let our 
administrative or clinical actions be in accordance with this conclu- 
sion. 


10. p values. Instead of saying that an observed value of the test statistic 
is significant or is not significant, most writers in the research 
literature prefer to report the exact probability of getting a value as 
extreme as or more extreme than that observed if the null hypothesis is 
true. In the present instance these writers would give the computed 
value of the test statistic along with the statement p — .0340. The 
statement p — .0340 means that the probability of getting a value as 
extreme as 2.12 in either direction, when the null hypothesis is true, is 
.0340. The value .0340 is obtained from Appendix Table D and is the 
probability of observing a z 2 2.12 or a z € —2.12 when the null 
hypothesis is true. That is, when Но is true, the probability of 
obtaining a value of z as large as or larger than 2.12 is .0170, and 
the probability of observing a value of z as small as or smaller than 
—2.12 is .0170. The probability of one or the other of these events 
occurring, when Hj is true, is equal to the sum of the two individual 
probabilities, and hence, in the present example, we say that 
р = 0170 + .0170 = .0340. 


Recall that the p value for a test may be defined also as the 
smallest value of o for which the null hypothesis can be rejected. Since, 
in Example 7.2.1, our p value is .0340, we know that we could have 
chosen an о value as small as .0340 and still have rejected the null 
hypothesis. If we had chosen an o smaller than .0340, we would not have 
been able to reject the null hypothesis. A general rule worth 
remembering, then, is this: if the p value is less than or equal to a, 
we reject the null hypothesis; if the p value is greater than а, we do not 
reject the null hypothesis. 

The reporting of p values as part of the results of an investigation is 
more informative to the reader than such statements as "the null hypothesis is 
rejected at the .05 level of significance" or “the results were not significant at 
the .05 level." Reporting the p value associated with a test lets the reader 
know just how common or how rare is the computed value of the test statistic 
given that Но is true. и 


Testing Но by Means of а Confidence Interval Earlier, we stated that 
one can use confidence intervals to test hypotheses. In Example 7.2.1 we used a 
hypothesis testing procedure to test Ho: и = 30 against the alternative, Ha: u У 30. 
We were able to reject Но because the computed value of the test statistic fell in the 
rejection region. 
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Let us see how we might have arrived at this same conclusion by using a 100(1 — о) 
percent confidence interval. The 95 percent confidence interval for u is 


27 + 1.96,/20/10 
27 + 1.96(1.414) 


27+2.7714 
(24.2286, 29.7714) 


Since this interval does not include 30, we say 30 is not a candidate for the mean we are 
estimating and, therefore, м is not equal to 30 and Но is rejected. This is the same 
conclusion reached by means of the hypothesis testing procedure. 

If the hypothesized parameter, 30, had been within the 95 percent confidence 
interval, we would have said that Но is not rejected at the .05 level of significance. In 
general, when testing a null hypothesis by means of a two-sided confidence interval, we 
reject Но at the a level of significance if the hypothesized parameter is not contained within 
the 100(1 — о) percent confidence interval. If the hypothesized parameter is contained 
within the interval, Но cannot be rejected at the o level of significance. 


One-Sided Hypothesis Tests The hypothesis test illustrated by Example 
7.2.1 is an example of a two-sided test, so called because the rejection region is split 
between the two sides or tails of the distribution of the test statistic. A hypothesis test may 
be one-sided, in which case all the rejection region is in one or the other tail of the 
distribution. Whether a one-sided or a two-sided test is used depends on the nature of the 
question being asked by the researcher. 

If both large and small values will cause rejection of the null hypothesis, a two-sided 
test is indicated. When either sufficiently “small” values only or sufficiently “large” values 
only will cause rejection of the null hypothesis, a one-sided test is indicated. 


EXAMPLE 7.2.2 


Refer to Example 7.2.1. Suppose, instead of asking if they could conclude that u 4 30, the 
researchers had asked: Can we conclude that yu < 30? To this question we would reply that 
they can so conclude if they can reject the null hypothesis that u > 30. 


Solution: Let us go through the ten-step procedure to reach a decision based on a 
one-sided test. 
1. Data. See the previous example. 
2. Assumptions. See the previous example. 
3. Hypotheses. 


Ho: u > 30 
НА: и < 30 


The inequality in the null hypothesis implies that the null hypothesis 
consists of an infinite number of hypotheses. The test will be made only 
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at the point of equality, since it can be shown that if Но is rejected when 
the test is made at the point of equality it would be rejected if the test 
were done for any other value of и indicated in the null hypothesis. 


4. Test statistic. 


х= Ho 


EZ 


5. Distribution of test statistic. See the previous example. 


© 


6. Decision rule. Let us again use о = .05. To determine where to place the 
rejection region, let us ask ourselves what magnitude of values would 
cause rejection of the null hypothesis. If we look at the hypotheses, we 
see that sufficiently small values would cause rejection and that large 
values would tend to reinforce the null hypothesis. We will want our 
rejection region to be where the small values are—at the lower tail of the 
distribution. This time, since we have a one-sided test, all of o will go in 
the one tail of the distribution. By consulting Appendix Table D, we find 
that the value of z to the left of which lies .05 of the area under the 
standard normal curve is —1.645 after interpolating. Our rejection and 
nonrejection regions are now specified and are shown in Figure 7.2.2. 

Our decision rule tells us to reject Ho if the computed value of the 
test statistic is less than or equal to —1.645. 


7. Calculation of test statistic. From our data we compute 
27 — 
= а. —2.12 


J/20/10 | 


8. Statistical decision. We are able to reject the null hypothesis since 
—2.12 « —1.645. 

9. Conclusion. We conclude that the population mean is smaller than 30 
and act accordingly. 


10. p value. The p value for this test is 0170, since P(z € —2.12), when Ho 
is true, is .0170 as given by Appendix Table D when we determine the 


-1.645 0 2 


А 
Y Y 


Rejection region Nonrejection region 


FIGURE 7.2.2 Rejection and nonrejection regions for Example 7.2.2. 
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magnitude of the area to the left of —2.12 under the standard normal 
curve. One can test a one-sided null hypothesis by means of a one-sided 
confidence interval. However, we will not cover the construction and 
interpretation of this type of confidence interval in this book. 


If the researcher's question had been, “Can we conclude that the mean is 
greater than 307”, following the above ten-step procedure would have led to a 
one-sided test with all the rejection region at the upper tail of the distribution 
of the test statistic and a critical value of 4-1.645. E 


Sampling from a Normally Distributed Population: Population 
Variance Unknown As we have already noted, the population variance is usually 
unknown in actual situations involving statistical inference about a population mean. When 
sampling is from an approximately normal population with an unknown variance, the test 
statistic for testing Ho: и = Шо is 


_Х- Ho 


s/n 


which, when Но is true, is distributed as Student's t with n — 1 degrees of freedom. The 
following example illustrates the hypothesis testing procedure when the population is 
assumed to be normally distributed and its variance is unknown. This is the usual situation 
encountered in practice. 


t 


(1.2.2) 


EXAMPLE 7.2.3 


Nakamura et al. (A-1) studied subjects with medial collateral ligament (MCL) and anterior 
cruciate ligament (ACL) tears. Between February 1995 and December 1997, 17 consecu- 
tive patients with combined acute ACL and grade III MCL injuries were treated by the 
same physician at the research center. One of the variables of interest was the length of time 
in days between the occurrence of the injury and the first magnetic resonance imaging 
(MRD. The data are shown in Table 7.2.1. We wish to know if we can conclude that the 
mean number of days between injury and initial MRI is not 15 days in a population 
presumed to be represented by these sample data. 


TABLE 7.2.1 Number of Days Until MRI for Subjects with MCL and ACL Tears 


Subject Days Subject Days Subject Days Subject Days 
1 14 6 0 11 28 16 14 
2 9 7 10 12 24 17 9 
3 18 8 4 13 24 

4 26 9 8 14 2 

5 12 10 21 15 3 


Source: Norimasa Nakamura, Shuji Horibe, Yukyoshi Toritsuka, Tomoki Mitsuoka, Hideki Yoshikawa, and 
Konsei Shino, “Acute Grade Ш Medial Collateral Ligament Injury of the Knee Associated with Anterior Cruciate 
Ligament Tear," American Journal of Sports Medicine, 31 (2003), 261-267. 
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Solution: We will be able to conclude that the mean number of days for the population 
is not 15 if we can reject the null hypothesis that the population mean is 
equal to 15. 


1. Data. The data consist of number of days until MRI on 17 subjects as 
previously described. 


2. Assumptions. The 17 subjects constitute a simple random sample from 
a population of similar subjects. We assume that the number of days 
until MRI in this population is approximately normally distributed. 


3. Hypotheses. 
Но: и = 15 
НА: м 15 


4. Test statistic. Since the population variance is unknown, our test 
statistic is given by Equation 7.2.2. 


5. Distribution of test statistic. Our test statistic is distributed as 
Student's г with n — 1 = 17 — 1 = 16 degrees of freedom if Но is true. 


6. Decision rule. Let a = .05. Since we have a two-sided test, we put 
0/2 = .025 in each tail of the distribution of our test statistic. The / 
values to the right and left of which .025 of the area lies are 2.1199 and 
—2.1199. These values are obtained from Appendix Table E. The 
rejection and nonrejection regions are shown in Figure 7.2.3. 

The decision rule tells us to compute a value of the test statistic and 
reject Ho if the computed 1 is either greater than or equal to 2.1199 or less 
than or equal to —2.1199. 


7. Calculation of test statistic. From our sample data we compute a 
sample mean of 13.2941 and a sample standard deviation of 8.88654. 
Substituting these statistics into Equation 7.2.2 gives 


_ 13.2941 — 15 —1.7059 


= = —.791 
8.88654/y17 2.1553 


.95 
.025 .025 
bd 
-2.1199 0 2.1199 t 
Rejection region Nonrejection Rejection region 
region 


FIGURE 7.2.3 Rejection and nonrejection regions for Example 7.2.3. 
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р/2 > .10 р/2 > .10 


e 
-1.337 —791 0 791 1.337 t 
р>.20 


FIGURE 7.2.4 Determination of p value for Example 7.2.3. 


8. Statistical decision. Do not reject Ho, since —.791 falls in the non- 
rejection region. 

9. Conclusion. Our conclusion, based on these data, is that the mean of the 
population from which the sample came may be 15. 


10. p value. The exact p value for this test cannot be obtained from 
Appendix Table E since it gives t values only for selected percentiles. 
The p value can be stated as an interval, however. We find that —.791 is 
less than — 1.337, the value of t to the left of which lies .10 of the area 
under the г with 16 degrees of freedom. Consequently, when Но is true, 
the probability of obtaining a value of t as small as or smaller than —.791 
is greater than .10. That is P(t € —.791) > .10. Since the test was two- 
sided, we must allow for the possibility of a computed value of the test 
statistic as large in the opposite direction as that observed. Appendix 
Table E reveals that P(t 2 .791) > .10 also. The p value, then, is 
p > 20. In fact, Excel calculates the p value to be .4403. Figure 
7.2.4 shows the p value for this example. 


If in the previous example the hypotheses had been 


Ho: u > 15 
НА: и < 15 


the testing procedure would have led to а one-sided test with all the rejection 
region at the lower tail of the distribution, and if the hypotheses had been 


Но: и < 15 
НА: и > 15 


we would have had a one-sided test with all the rejection region at the upper 
tail of the distribution. и 


Sampling from a Population That Is Not Normally Distributed 
If, as is frequently the case, the sample on which we base our hypothesis test about a 
population mean comes from a population that is not normally distributed, we may, if our 
sample is large (greater than or equal to 30), take advantage of the central limit theorem and 
use < = (Xx — uo)/(o/ n) as the test statistic. If the population standard deviation is not 
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known, the usual practice is to use the sample standard deviation as an estimate. The test 
statistic for testing Ho: и = Шо, then, is 


X — Ho 


= - (7.2.3) 


ра 


which, when Но is true, is distributed approximately as the standard normal distribution if п 
is large. The rationale for using s to replace o is that the large sample, necessary for the 
central limit theorem to apply, will yield a sample standard deviation that closely 
approximates o. 


EXAMPLE 7.2.4 


The goal of a study by Klingler et al. (A-2) was to determine how symptom recognition and 
perception influence clinical presentation as a function of race. They characterized 
symptoms and care-seeking behavior in African-American patients with chest pain 
seen in the emergency department. One of the presenting vital signs was systolic blood 
pressure. Among 157 African-American men, the mean systolic blood pressure was 
146 mm Hg with a standard deviation of 27. We wish to know if, on the basis of these 
data, we may conclude that the mean systolic blood pressure for a population of African- 
American men is greater than 140. 


Solution: We will say that the data do provide sufficient evidence to conclude that the 
population mean is greater than 140 if we can reject the null hypothesis that 
the mean is less than or equal to 140. The following test may be carried out: 


1. Data. The data consist of systolic blood pressure scores for 157 African- 
American men with x — 146 and s — 27. 


2. Assumptions. The data constitute a simple random sample from a 
population of African-American men who report to an emergency 
department with symptoms similar to those in the sample. We are 
unwilling to assume that systolic blood pressure values are normally 
distributed in such a population. 


3. Hypotheses. 


Ho: u < 140 
На: и» 140 


4. Test statistic. The test statistic is given by Equation 7.2.3, since s is 
unknown. 


5. Distribution of test statistic. Because of the central limit theorem, the 
test statistic is at worst approximately normally distributed with u = O if 
Ho is true. 

6. Decision rule. Let o — .05. The critical value of the test statistic is 
1.645. The rejection and nonrejection regions are shown in Figure 7.2.5. 
Reject Но if computed z > 1.645. 
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e 
0 1.645 2 
] 


Y Y 


Nonrejection region Rejection region 


FIGURE 7.2.5 Rejection and nonrejection regions for Example 7.2.4. 


7. Calculation of test statistic. 


146 — 140 6 
z= = 
27/1157 2.1548 


8. Statistical decision. Reject Но since 2.78 > 1.645. 


9. Conclusion. Conclude that the mean systolic blood pressure for the 
sampled population is greater than 140. 


= 2.78 


10. p value. The p value for this testis 1 — .9973 = .0027, since as shown in 
Appendix Table D, the area (.0027) to the right of 2.78 is less than .05, 
the area to the right of 1.645. H 


Procedures for Other Conditions If the population variance had been 
known, the procedure would have been identical to the above except that the known 
value of c, instead of the sample value s, would have been used in the denominator of the 
computed test statistic. 

Depending on what the investigators wished to conclude, either a two-sided test or a 
one-sided test, with the rejection region at the lower tail of the distribution, could have been 
made using the above data. 

When testing a hypothesis about a single population mean, we may use Figure 6.3.3 
to decide quickly whether the test statistic 15 z Or f. 


Computer Analysis To illustrate the use of computers in testing hypotheses, we 
consider the following example. 


EXAMPLE 7.2.5 
The following are the head circumferences (centimeters) at birth of 15 infants: 


33.38 32.15 33.99 34.10 33.97 
34.34 33.95 33.85 34.23 32.73 
33.46 34.13 34.45 34.19 34.05 


We wish to test Но: и = 34.5 against Ha: u 5 34.5. 
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Dialog box: Session command: 


Stat » Basic Statistics » 1-Sample t MTB > TTEST 34.5 C1 


Type СІ in Samples in columns. Type 34.5 
in the Test mean box. Click OK. 


Output: 
One-Sample T: C1 
TEST OF MU = 34.5 VS NOT = 34.5 


VARIABLE М MEAN  STDEV SE MEAN 95$ CI T P 
cl 15 33.7980 0.6303 0.1627 (33.4490, 34.1470) —4.31 0.001 


FIGURE 7.2.6 MINITAB procedure and output for Example 7.2.5. 


Solution: We assume that the assumptions for use of the ¢ statistic are met. We enter the 
data into Column 1 and proceed as shown in Figure 7.2.6. 

To indicate that a test is one-sided when in Windows, click on the 
Options button and then choose “less than" or “greater than” as appropriate 
in the Alternative box. If z is the appropriate test statistic, we choose 
1-Sample z from the Basic Statistics menu. The remainder of the commands 
are the same as for the 1 test. 

We learn from the printout that the computed value of the test statistic is 
—4.31 and the p value for the test is .0007. SAS? users may use the output 
from PROC MEANS or PROC UNIVARIATE to perform hypothesis tests. 

When both the z statistic and the 7 statistic are inappropriate test 
statistics for use with the available data, one may wish to use a non- 
parametric technique to test a hypothesis about a single population measure 
of central tendency. One such procedure, the sign test, is discussed in 
Chapter 13. п 


EXERCISES 


For each of the following exercises carry out the ten-step hypothesis testing procedure for the given 
significance level. For each exercise, as appropriate, explain why you chose a one-sided test or a two- 
sided test. Discuss how you think researchers and/or clinicians might use the results of your 
hypothesis test. What clinical and/or research decisions and/or actions do you think would be 
appropriate in light of the results of your test? 


7.2.1 Escobar et al. (A-3) performed a study to validate a translated version of the Western Ontario and 
McMaster Universities Osteoarthritis Index (WOMAC) questionnaire used with Spanish-speaking 
patients with hip or knee osteoarthritis. For the 76 women classified with severe hip pain, the 
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7.2.2 


7.2.3 


7.2.4 


7.2.5 


7.2.6 


7.2.7 


7.2.8 


7.2.9 


WOMAC mean function score (on a scale from 0 to 100 with a higher number indicating less 
function) was 70.7 with a standard deviation of 14.6. We wish to know if we may conclude that the 
mean function score for a population of similar women subjects with severe hip pain is less than 75. 
Let a = .01. 


A study by Thienprasiddhi et al. (A-4) examined a sample of 16 subjects with open-angle glaucoma 
and unilateral hemifield defects. The ages (years) of the subjects were: 


62 62 68 48 51 60 51 57 
57 41 62 50 53 34 62 61 
Source: Phamornsak Thienprasiddhi, Vivienne C. Greenstein, 
Candice S. Chen, Jeffrey M. Liebmann, Robert Ritch, and 
Donald C. Hood, “Multifocal Visual Evoked Potential 
Responses in Glaucoma Patients with Unilateral Hemifield 
Defects,” American Journal of Ophthalmology, 136 (2003), 
34-40. 


Can we conclude that the mean age of the population from which the sample may be presumed to 
have been drawn is less than 60 years? Let o — .05. 


The purpose of a study by Luglié et al. (A-5) was to investigate the oral status of a group of patients 
diagnosed with thalassemia major (TM). One of the outcome measures was the decayed, missing, and 
filled teeth index (DMFT). In a sample of 18 patients the mean DMFT index value was 10.3 with a 
standard deviation of 7.3. Is this sufficient evidence to allow us to conclude that the mean DMFT 
index is greater than 9.0 in a population of similar subjects? Let а = .10. 


A study was made of a sample of 25 records of patients seen at a chronic disease hospital on an 
outpatient basis. The mean number of outpatient visits per patient was 4.8, and the sample standard 
deviation was 2. Can it be concluded from these data that the population mean is greater than four 
visits per patient? Let the probability of committing a type I error be .05. What assumptions are 
necessary? 


In a sample of 49 adolescents who served as the subjects in an immunologic study, one variable of 
interest was the diameter of skin test reaction to an antigen. The sample mean and standard deviation 
were 21 and 11 mm erythema, respectively. Can it be concluded from these data that the population 
mean is less than 30? Let o — .05. 


Nine laboratory animals were infected with a certain bacterium and then immunosuppressed. The 
mean number of organisms later recovered from tissue specimens was 6.5 (coded data) with a 
standard deviation of .6. Can one conclude from these data that the population mean is greater than 6? 
Let а = .05. What assumptions are necessary? 


A sample of 25 freshman nursing students made a mean score of 77 on a test designed to measure 
attitude toward the dying patient. The sample standard deviation was 10. Do these data provide 
sufficient evidence to indicate, at the .05 level of significance, that the population mean is less than 
80? What assumptions are necessary? 


We wish to know if we can conclude that the mean daily caloric intake in the adult rural population of 
a developing country is less than 2000. A sample of 500 had a mean of 1985 and a standard deviation 
of 210. Let a = .05. 


A survey of 100 similar-sized hospitals revealed a mean daily census in the pediatrics service of 27 
with a standard deviation of 6.5. Do these data provide sufficient evidence to indicate that the 
population mean is greater than 25? Let а = .05. 


7.2.10 


7.2.11 


7.2.12 


7.2.13 


7.2.14 


7.2.15 


7.2.16 
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Following a week-long hospital supervisory training program, 16 assistant hospital administrators 
made a mean score of 74 on a test administered as part of the evaluation of the training program. The 
sample standard deviation was 12. Can it be concluded from these data that the population mean is 
greater than 70? Let œ = .05. What assumptions are necessary? 


A random sample of 16 emergency reports was selected from the files of an ambulance service. 
The mean time (computed from the sample data) required for ambulances to reach their 
destinations was 13 minutes. Assume that the population of times is normally distributed with 
a variance of 9. Can we conclude at the .05 level of significance that the population mean is greater 
than 10 minutes? 


The following data are the oxygen uptakes (milliliters) during incubation of a random sample of 
15 cell suspensions: 


14.0, 14.1, 14.5, 13.2, 11.2, 14.0, 14.1, 12.2, 
11.1, 13.7, 132, 16.0, 12.8, 14.4, 12.9 


Do these data provide sufficient evidence at the .05 level of significance that the population mean is 
not 12 ml? What assumptions are necessary? 


Can we conclude that the mean maximum voluntary ventilation value for apparently healthy college 
seniors is not 110 liters per minute? A sample of 20 yielded the following values: 


132, 33, 91, 108, 67, 169, 54, 203, 190, 133, 
96, 30, 187, 21, 63, 166, 84, 110, 157, 138 


Let a = .01. What assumptions are necessary? 


The following are the systolic blood pressures (mm Hg) of 12 patients undergoing drug therapy for 
hypertension: 


183, 152, 178, 157, 194, 163, 144, 114, 178, 152, 118, 158 


Can we conclude on the basis of these data that the population mean is less than 165? Let a = .05. 
What assumptions are necessary? 


Can we conclude that the mean age at death of patients with homozygous sickle-cell disease is less 
than 30 years? A sample of 50 patients yielded the following ages in years: 


15.5 2.0 451 1.7 8 1.1 182 9.7 281 182 
27.6 450 10 664 20 674 2.5 61.7 162 31.7 

6.9 13.5 19 312 9.0 2.6 29.7 13.5 2.6 144 
20.7 30.9 36.6 1.1 23.6 9 7.6 23.5 6.3 40.2 
23.7 48 332 271 36.7 32 38.0 3.5 218 2.4 


Let a = .05. What assumptions are necessary? 


The following are intraocular pressure (mm Hg) values recorded for a sample of 21 elderly 
subjects: 


145 129 140 161 120 175 141 129 179 12.0 
164 242 122 144 170 100 185 208 162 149 
19.6 


Can we conclude from these data that the mean of the population from which the sample was drawn is 
greater than 14? Let а = .05. What assumptions are necessary? 
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7.2.17 


7.2.18 


7.2.19 


Suppose it is known that the IQ scores of a certain population of adults are approximately 
normally distributed with a standard deviation of 15. A simple random sample of 25 adults drawn 
from this population had a mean IQ score of 105. On the basis of these data can we conclude that 
the mean IQ score for the population is not 100? Let the probability of committing a type I error 
be .05. 


A research team is willing to assume that systolic blood pressures in a certain population of males are 
approximately normally distributed with a standard deviation of 16. A simple random sample of 64 
males from the population had a mean systolic blood pressure reading of 133. At the .05 level of 
significance, do these data provide sufficient evidence for us to conclude that the population mean is 
greater than 130? 


A simple random sample of 16 adults drawn from a certain population of adults yielded a mean 
weight of 63 kg. Assume that weights in the population are approximately normally distributed with a 
variance of 49. Do the sample data provide sufficient evidence for us to conclude that the mean 
weight for the population is less than 70 kg? Let the probability of committing a type I error be .01. 


7.3 HYPOTHESIS TESTING: 
THE DIFFERENCE BETWEEN TWO 
POPULATION MEANS 


Hypothesis testing involving the difference between two population means is most 
frequently employed to determine whether or not it is reasonable to conclude that the 
two population means are unequal. In such cases, one or the other of the following 
hypotheses may be formulated: 


1. Нуш – о = 0, Ha: p ш FO 
2. Но: ш — шю 2 0, НА: ш = 2 < 0 
3. Но: ш — шо < 0, Наш => 0 


It is possible, however, to test the hypothesis that the difference is equal to, greater 
than or equal to, or less than or equal to some value other than zero. 

As was done in the previous section, hypothesis testing involving the difference 
between two population means will be discussed in three different contexts: (1) when 
sampling is from normally distributed populations with known population variances, (2) 
when sampling is from normally distributed populations with unknown population 
variances, and (3) when sampling is from populations that are not normally distributed. 


Sampling from Normally Distributed Populations: Population 
Variances Known When each of two independent simple random samples has 
been drawn from a normally distributed population with a known variance, the test statistic 
for testing the null hypothesis of equal population means is 

z= ez EN X2) = (Hy = 12) (7.3.1) 


ої | 0j 
— 4+ — 


т n» 
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where the subscript O indicates that the difference is a hypothesized parameter. When Но 
is true the test statistic of Equation 7.3.1 is distributed as the standard normal. 


EXAMPLE 7.3.1 


Researchers wish to know if the data they have collected provide sufficient evidence to 
indicate a difference in mean serum uric acid levels between normal individuals and 
individuals with Down's syndrome. The data consist of serum uric acid readings 
оп 12 individuals with Down's syndrome and 15 normal individuals. The means are x; = 
4.5 mg/100 ml and x; = 3.4 mg/100 ml. 


Solution: We will say that the sample data do provide evidence that the population 
means are not equal if we can reject the null hypothesis that the population 
means are equal. Let us reach a conclusion by means of the ten-step 
hypothesis testing procedure. 


1. Data. See problem statement. 


2. Assumptions. The data constitute two independent simple random 
samples each drawn from a normally distributed population with a 
variance equal to 1 for the Down's syndrome population and 1.5 for the 
normal population. 

3. Hypotheses. 

Ho: ш — шо =0 
НА: ш — My # 0 


An alternative way of stating the hypotheses is as follows: 


Ho: ш = Ma 
НА: Ш T Ma 
4. Test statistic. The test statistic is given by Equation 7.3.1. 


5. Distribution of test statistic. When the null hypothesis is true, the test 
statistic follows the standard normal distribution. 


6. Decision rule. Leto = .05. The critical values of z are +1.96. Reject Ho 
unless — 1.96 < Zcomputed < 1.96. The rejection and nonrejection regions 
are shown in Figure 7.3.1. 


7. Calculation of test statistic. 


СЕРЕ ОРОО У И 
y/1/12+1.5/15 4282 


8. Statistical decision. Reject Ho, since 2.57 > 1.96. 


9. Conclusion. Conclude that, on the basis of these data, there is an 
indication that the two population means are not equal. 


10. p value. For this test, p — .0102. 


2.57 
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FIGURE 7.3.1 Rejection and nonrejection regions for Example 7.3.1 B 


A 95 Percent Confidence Interval for ш; — 42 In the previous chapter 
the 95 percent confidence interval for ш — u2, computed from the same data, was 
found to be .26 to 1.94. Since this interval does not include 0, we say that 0 is not a 
candidate for the difference between population means, and we conclude that the 
difference is not zero. Thus we arrive at the same conclusion by means of a confidence 
interval. 


Sampling from Normally Distributed Populations: Population 
Variances Unknown As we have learned, when the population variances are 
unknown, two possibilities exist. The two population variances may be equal or they may 
be unequal. We consider first the case where it is known, or it is reasonable to assume, that 
they are equal. A test of the hypothesis that two population variances are equal is described 
in Section 7.8. 


Population Variances Equal When the population variances are unknown, 
but assumed to be equal, we recall from Chapter 6 that it is appropriate to pool the sample 
variances by means of the following formula: 


2 (ni = 1)5{ + (по — 1)s$ 


Р n +m-—2 
When each of two independent simple random samples has been drawn from a normally 
distributed population and the two populations have equal but unknown variances, the test 


statistic for testing Но: шу = шо is given by 


(%1 — ха) — (ш — Modo 


t= (7.3.2) 
52 52 
р ES UD 
ni п» 


which, when Но is true, is distributed as Student's t with n; + m — 2 degrees of freedom. 
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EXAMPLE 7.3.2 


The purpose of a study by Tam et al. (A-6) was to investigate wheelchair maneuvering in 
individuals with lower-level spinal cord injury (SCI) and healthy controls (C). Subjects 
used a modified wheelchair to incorporate a rigid seat surface to facilitate the specified 
experimental measurements. Interface pressure measurement was recorded by using a 
high-resolution pressure-sensitive mat with a spatial resolution of four sensors per square 
centimeter taped on the rigid seat support. During static sitting conditions, average 
pressures were recorded under the ischial tuberosities (the bottom part of the pelvic 
bones). The data for measurements of the left ischial tuberosity (in mm Hg) for the SCI and 
control groups are shown in Table 7.3.1. We wish to know if we may conclude, on the basis 
of these data, that, in general, healthy subjects exhibit lower pressure than SCI subjects. 


Solution: 


1. Data. See statement of problem. 

2. Assumptions. The data constitute two independent simple random 
samples of pressure measurements, one sample from a population of 
control subjects and the other sample from a population with lower-level 
spinal cord injury. We shall assume that the pressure measurements in 
both populations are approximately normally distributed. The popula- 
tion variances are unknown but are assumed to be equal. 

3. Hypotheses. Ho: Ис > Изсь НА: Ис < Esct- 

4. Test statistic. The test statistic is given by Equation 7.3.2. 

5. Distribution of test statistic. When the null hypothesis is true, the test 
statistic follows Student's г distribution with n, + пә — 2 degrees of 
freedom. 

6. Decision rule. Leto — .05. The critical value of tis — 1.7341. Reject Ho 
unless fcomputed > — 1.7341. 


7. Calculation of test statistic. From the sample data we compute 
Xc = 126.1, Sc = 21.8, XSCI = 133.1, SSCI = 32.2 


Next, we pool the sample variances to obtain 


9(21.8)? + 9(32.2) 
2 
$= cd — 756.04 


TABLE 7.3.1 Pressures (mm Hg) Under the Pelvis during Static Conditions for 
Example 7.3.2 


131 115 124 131 122 117 88 114 150 169 
60 150 130 180 163 130 121 119 130 148 


Control 
SCI 


Source: Eric W. Tam, Arthur F. Mak, Wai Nga Lam, John H. Evans, and York Y. Chow, "Pelvic Movement and 
Interface Pressure Distribution During Manual Wheelchair Propulsion," Archives of Physical Medicine and 
Rehabilitation, 84 (2003), 1466-1472. 


240  cHAPTER7 HYPOTHESIS TESTING 


We now compute 


126.1 — 133.1) — 
jn £ ше. .569 


756.04 " 756.04 — 
V 10 10 


8. Statistical decision. We fail to reject Но, since —1.7341 < —.569; that 
is, —.569 falls in the nonrejection region. 


9. Conclusion. On the basis of these data, we cannot conclude that the 
population mean pressure is less for healthy subjects than for SCI 
subjects. 

10. p value. For this test, p > .10 using Table E, or .5764 using a computer 
since —1.330 < —.569. и 


Population Variances Unequal When two independent simple random 


samples have been drawn from normally distributed populations with unknown and 
unequal variances, the test statistic for testing Ho: шу = [2 is 


‚_ @ — 32) = CH и) 


{= (7.3.3) 
2 2 
$1 4E 52 
п n» 


The critical value of /' for an о level of significance and a two-sided test is approximately 


wit) + Wolo 
t-a) = ER (7.3.4) 


where и = 52 /ni, Wo = 52 п», п = fi-(a/2) for nı — 1 degrees of freedom, and t = 
t1-(a/2) for n2 — 1 degrees of freedom. The critical value of t for a one-sided test is 
found by computing г , by Equation 7.3.4, using tı = ti-o for пу — 1 degrees of freedom 
and № = Н_ for n; — 1 degrees of freedom. 

For a two-sided test, reject Но if the computed value of Г is either greater than or 
equal to the critical value given by Equation 7.3.4 or less than or equal to the negative of 
that value. 

For a one-sided test with the rejection region in the right tail of the sampling distribution, 
reject Но if the computed 7 is equal to or greater than the critical ¢’. For a one-sided test with a 
left-tail rejection region, reject Но if the computed value of /' is equal to or smaller than the 
negative of the critical ^ computed by the indicated adaptation of Equation 7.3.4. 


EXAMPLE 7.3.3 


Dernellis and Panaretou (A-7) examined subjects with hypertension and healthy control 
subjects. One of the variables of interest was the aortic stiffness index. Measures of this 
variable were calculated from the aortic diameter evaluated by M-mode echocardiography 
and blood pressure measured by a sphygmomanometer. Generally, physicians wish to 
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reduce aortic stiffness. In the 15 patients with hypertension (group 1), the mean aortic 
stiffness index was 19.16 with a standard deviation of 5.29. In the 30 control subjects 
(group 2), the mean aortic stiffness index was 9.53 with a standard deviation of 2.69. We 
wish to determine if the two populations represented by these samples differ with respect to 
mean aortic stiffness index. 


Solution: 


1. Data. The sample sizes, means, and sample standard deviations are: 


пі = 15, # = 19.16, з; = 529 
n = 30, 5 = 9.53, 5 = 2.69 


2. Assumptions. The data constitute two independent random samples, 
one from a population of subjects with hypertension and the other from a 
control population. We assume that aortic stiffness values are approxi- 
mately normally distributed in both populations. The population vari- 
ances are unknown and unequal. 


3. Hypotheses. 


Ho: ш — ш = 0 
НА: ш = о 0 


4. Test statistic. The test statistic is given by Equation 7.3.3. 


5. Distribution of test statistic. The statistic given by Equation 7.3.3 does 
not follow Student's г distribution. We, therefore, obtain its critical 
values by Equation 7.3.4. 


6. Decision rule. Let о = .05. Before computing / we calculate w; = 
(5.29)? /15 = 1.8656 and wz = (2.69)? /30 = 2412. In Appendix Table 
E we find that t; = 2.1448 and № = 2.0452. By Equation 7.3.4 we 
compute 


du 1.8656(2.1448) + 2412(2.0452) _ за 
i 1.8656 + .2412 m 


Our decision rule, then, is reject Но if the computed 1 is either > 2.133 
or < —2.133. 


7. Calculation of test statistic. By Equation 7.3.3 we compute 


19.16 — 9.53) — і 
jis С җе а 


(5.29)? ш (go. ЗОВ 
15 30 


242 


CHAPTER7 HYPOTHESIS TESTING 


8. Statistical decision. Since 6.63 2.133, we reject Ho. 


9, Conclusion. On the basis of these results we conclude that the two 
population means are different. 


10. p value. For this test p « .05; program R calculates this value to be 
« .00001. ш 


Sampling from Populations That Are Not Normally Distributed 
When sampling is from populations that are not normally distributed, the results of the 
central limit theorem may be employed if sample sizes are large (say, > 30). This will 
allow the use of normal theory since the distribution of the difference between sample 
means will be approximately normal. When each of two large independent simple 
random samples has been drawn from a population that is not normally distributed, 
the test statistic for testing Ho: шу = Ma 15 


(xı ха) — (ро Мод 


z= (7.3.5) 
ої | 0) 
п п» 


which, when Но is true, follows the standard normal distribution. If the population 
variances are known, they are used; but if they are unknown, as is the usual case, the 
sample variances, which are necessarily based on large samples, are used as estimates. 
Sample variances are not pooled, since equality of population variances is not a necessary 
assumption when the z statistic is used. 


EXAMPLE 7.3.4 


The objective of a study by Sairam et al. (A-8) was to identify the role of various disease 
states and additional risk factors in the development of thrombosis. One focus of the 
study was to determine if there were differing levels of the anticardiolipin antibody IgG 
in subjects with and without thrombosis. Table 7.3.2 summarizes the researchers' 
findings: 


TABLE 7.3.2 IgG Levels for Subjects With and Without Thrombosis 
for Example 7.3.4 


Mean IgG Level 


Group (ml/unit) Sample Size Standard Deviation 
Thrombosis 59.01 53 44.89 
No thrombosis 46.61 54 34.85 


Source: S. Sairam, B. A. Baethge and T. McNearney, “Analysis of Risk Factors and Comorbid 
Diseases in the Development of Thrombosis in Patients with Anticardiolipin Antibodies,” 
Clinical Rheumatology, 22 (2003), 24-29. 
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We wish to know if we may conclude, on the basis of these results, that, in general, 
persons with thrombosis have, on the average, higher IgG levels than persons without 
thrombosis. 


Solution: 


1. Data. See statement of example. 


2. Assumptions. The statistics were computed from two independent 
samples that behave as simple random samples from a population of 
persons with thrombosis and a population of persons who do not have 
thrombosis. Since the population variances are unknown, we will use the 
sample variances in the calculation of the test statistic. 


3. Hypotheses. 


Но: ит — ихт < 0 
НА: ит — Unt > 0 


or, alternatively, 


Ho: ит < ихт 
НА: ит > UNT 


4. Test statistic. Since we have large samples, the central limit theorem 
allows us to use Equation 7.3.5 as the test statistic. 


5. Distribution of test statistic. When the null hypothesis is true, the test 
statistic is distributed approximately as the standard normal. 


6. Decision rule. Leto — .01. This is a one-sided test with a critical value 
of z equal to 2.33. Reject Но if Zcomputed 2 2.33. 


7. Calculation of test statistic. 


.01 — 46.61 
= 59.0 6.6 — 159 


/44.89? Ж 34.85? 
53 54 
8. Statistical decision. Fail to reject Но, since z = 1.59 is in the non- 
rejection region. 


9. Conclusion. These data indicate that on the average, persons with 
thrombosis and persons without thrombosis may not have differing IgG 
levels. 


10. p value. For this test, p — .0559. When testing a hypothesis about the 


difference between two populations means, we may use Figure 6.4.1 to 
decide quickly whether the test statistic should be z or f. P] 


We may use MINITAB to perform two-sample f tests. To illustrate, let us refer 
to the data in Table 7.3.1. We put the data for control subjects and spinal cord 
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Dialog box: Session command: 


Stat » Basic Statistics » 2-Sample t MTB » TwoSample 95.0 C1 
SUBC> Alternative -1, 

Choose Samples in different columns. Type C/ SUBC> Pooled. 

inFirst and C2 inSecond. Click the Options box 

and select “less than" in the Alternatives box. 

Check Assume equal variances. Click OK. 


Output: 


Two-Sample T-Test and CI: C, 


Two-sample T for C vs SCI 

N Mean StDev 
C 10 126.1 21.8 
SCI 10 133,1 32.2 


Difference = пи C - mu SCI 

Estimate for difference: -7.0 

95% upper bound for difference: 14.3 

T-Test of difference = 0 (vs <): T-Value = —0.57 P-Value = 0.288 
DF = 18 

Both use Pooled StDev = 27.5 


FIGURE 7.3.2  MINITAB procedure and output for two-sample t test, Example 7.3.2 
(data in Table 7.3.1). 


injury subjects in Column 1 and Column 2, respectively, and proceed as shown in 
Figure 7.3.2. 

The SAS® statistical package performs the f test for equality of population means 
under both assumptions regarding population variances: that they are equal and that they 
are not equal. Note that SAS? designates the p value as Pr > |t|. The default output is a 
p value for a two-sided test. The researcher using SAS? must divide this quantity in half 
when the hypothesis test is one-sided. The SAS? package also tests for equality of 
population variances as described in Section 7.8. Figure 7.3.3 shows the SAS? output 
for Example 7.3.2. 


Alternatives to 2 and t Sometimes neither the z statistic nor the г statistic is 
an appropriate test statistic for use with the available data. When such is the case, one 
may wish to use a nonparametric technique for testing a hypothesis about the difference 
between two population measures of central tendency. The Mann-Whitney test statistic 
and the median test, discussed in Chapter 13, are frequently used alternatives to the z and 
t statistics. 
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The SAS System 
The TTEST Procedure 


Variable 


Statistics Lower CL 
Lower CL Upper CL Std Std 
N Mean Mean Mean Dev Dev 


pressure 
pressure 
pressure 


10 110.49 126.1 141.71 .008 21.82 
10 110.08 133.1 156.12 .133 32.178 
—32.83 7 18.83 .773 27.491 


T-Tests 


Variable 


pressure 
pressure 


Method Variances DF 


Pooled Equal 18 
Satterthwaite Unequal 15.8 


Equality of Variances 


Variable 
pressure 


Method Num DF Den DF F Value 
Folded F 9 9 2217 


FIGURE 7.3.3 SAS? output for Example 7.3.2 (data in Table 7.3.1). 


EXERCISES 


7.3.1 


7.3.2 


In each of the following exercises, complete the ten-step hypothesis testing procedure. State the 
assumptions that are necessary for your procedure to be valid. For each exercise, as 
appropriate, explain why you chose a one-sided test or a two-sided test. Discuss how you 
think researchers or clinicians might use the results of your hypothesis test. What clinical or 
research decisions or actions do you think would be appropriate in light of the results of your 
test? 


Subjects in a study by Dabonneville et al. (A-9) included a sample of 40 men who claimed to engage 
in a variety of sports activities (multisport). The mean body mass index (BMI) for these men 
was 22.41 with a standard deviation of 1.27. A sample of 24 male rugby players had a mean BMI of 
27.75 with a standard deviation of 2.64. Is there sufficient evidence for one to claim that, in general, 
rugby players have a higher BMI than the multisport men? Let o = .01. 


The purpose of a study by Ingle and Eastell (A-10) was to examine the bone mineral density 
(BMD) and ultrasound properties of women with ankle fractures. The investigators recruited 31 
postmenopausal women with ankle fractures and 31 healthy postmenopausal women to serve as 
controls. One of the baseline measurements was the stiffness index of the lunar Achilles. The mean 
stiffness index for the ankle fracture group was 76.9 with a standard deviation of 12.6. In the 
control group, the mean was 90.9 with a standard deviation of 12.5. Do these data provide 
sufficient evidence to allow you to conclude that, in general, the mean stiffness index is higher in 
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7.3.3 


7.3.4 


healthy postmenopausal women than in postmenopausal women with ankle fractures? Let 
о = .05. 


Hoekema et al. (A-11) studied the craniofacial morphology of 26 male patients with obstructive sleep 
apnea syndrome (OSAS) and 37 healthy male subjects (non-OSAS). One of the variables of interest 
was the length from the most superoanterior point of the body of the hyoid bone to the Frankfort 
horizontal (measured in millimeters). 


Length (mm) Non-OSAS Length (mm) OSAS 

96.80 97.00 101.00 88.95 105.95 114.90 113.70 
100.70 97.70 88.25 101.05 114.90 114.35 116.30 

94.55 97.00 92.60 92.60 110.35 112.25 108.75 

99.65 94.55 98.25 97.00 123.10 106.15 113.30 
109.15 106.45 90.85 91.95 119.30 102.60 106.00 
102.75 94.55 95.25 88.95 110.00 102.40 101.75 

97.70 94.05 88.80 95.75 98.95 105.05 

92.10 89.45 101.40 114.20 112.65 

91.90 89.85 90.55 108.95 128.95 

89.50 98.20 109.80 105.05 117.70 


Source: Data provided courtesy of A. Hoekema, D.D.S. 


Do these data provide sufficient evidence to allow us to conclude that the two sampled 
populations differ with respect to length from the hyoid bone to the Frankfort horizontal? Let 
а = .01. 


Can we conclude that patients with primary hypertension (PH), on the average, have higher total 
cholesterol levels than normotensive (NT) patients? This was one of the inquiries of interest for Rossi 
et al. (A-12). In the following table are total cholesterol measurements (mg/dl) for 133 PH patients 
and 41 NT patients. Can we conclude that PH patients have, on average, higher total cholesterol 
levels than NT patients? Let о = .05. 


Total Cholesterol (mg/dl) 


Primary Hypertensive Patients Normotensive Patients 

207 221 212 220 190 286 189 
172 223 260 214 245 226 196 
191 181 210 215 171 187 142 
221 217 265 206 261 204 179 
203 208 206 247 182 203 212 
241 202 198 221 162 206 163 
208 218 210 199 182 196 196 
199 216 211 196 225 168 189 
185 168 274 239 203 229 142 
235 168 223 199 195 184 168 
214 214 175 244 178 186 121 
134 203 203 214 240 281 

226 280 168 236 222 203 


(Continued) 


7.3.5 


7.3.6 
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Total Cholesterol (mg/dl) 


Primary Hypertensive Patients Normotensive Patients 
222 203 178 249 117 177 135 
213 225 217 212 252 179 161 
272 227 200 259 203 194 
185 239 226 189 245 206 
181 265 207 235 218 219 
238 228 232 239 152 173 
141 226 182 239 231 189 
203 236 215 210 237 194 
222 195 239 203 196 
221 284 210 188 212 
180 183 207 237 168 
276 266 224 231 188 
226 258 251 222 232 
224 214 212 174 242 
206 260 201 219 200 


Source: Data provided courtesy of Gian Paolo Rossi, M.D., ЕА.С.С., EA.H.A. 


Gargáo and Cabrita (A-13) wanted to evaluate the community pharmacist's capacity to 
positively influence the results of antihypertensive drug therapy through a pharmaceutical 
care program in Portugal. Eighty-two subjects with essential hypertension were randomly 
assigned to an intervention or a control group. The intervention group received monthly 
monitoring by a research pharmacist to monitor blood pressure, assess adherence to 
treatment, prevent, detect, and resolve drug-related problems, and encourage nonpharmaco- 
logic measures for blood pressure control. The changes after 6 months in diastolic blood 
pressure (pre — post, mm Hg) are given in the following table for patients in each of the 
two groups. 


Intervention Group Control Group 
20 4 12 16 0 4 12 0 
2 24 6 10 12 2 2 8 
36 6 24 16 18 2 0 10 
26 —2 42 10 0 8 0 14 
2; 8 20 6 8 10 -4 8 
20 8 14 6 10 0 12 0 
2 16 -2 2 8 6 4 2 
14 14 10 8 14 10 28 -8 
30 8 2 16 4 -2 —18 16 
18 20 18 —12 —2 2 12 12 
6 —6 


Source: Data provided courtesy of José Gargáo, M.S., Pharm.D. 


On the basis of these data, what should the researcher conclude? Let a = .05. 


A test designed to measure mothers' attitudes toward their labor and delivery experiences was given 
to two groups of new mothers. Sample 1 (attenders) had attended prenatal classes held at the local 
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7.3.7 


7.3.8 


7.3.9 


health department. Sample 2 (nonattenders) did not attend the classes. The sample sizes and means 
and standard deviations of the test scores were as follows: 


Sample n X 5 
1 15 4.75 1.0 
22 3.00 1.5 


Do these data provide sufficient evidence to indicate that attenders, on the average, score higher than 
nonattenders? Let o — .05. 


Cortisol level determinations were made on two samples of women at childbirth. Group 1 subjects 
underwent emergency cesarean section following induced labor. Group 2 subjects delivered by either 
cesarean section or the vaginal route following spontaneous labor. The sample sizes, mean cortisol 
levels, and standard deviations were as follows: 


Sample n X s 
1 10 435 65 
12 645 80 


Do these data provide sufficient evidence to indicate a difference in the mean cortisol levels in the 
populations represented? Let а = .05. 


Protoporphyrin levels were measured in two samples of subjects. Sample 1 consisted of 50 adult male 
alcoholics with ring sideroblasts in the bone marrow. Sample 2 consisted of 40 apparently healthy 
adult nonalcoholic males. The mean protoporphyrin levels and standard deviations for the two 
samples were as follows: 


Sample x 5 
1 340 250 
45 25 


Can one conclude on the basis of these data that protoporphyrin levels are higher in the represented 
alcoholic population than in the nonalcoholic population? Let о = .01. 


A researcher was interested in knowing if preterm infants with late metabolic acidosis and 
preterm infants without the condition differ with respect to urine levels of a certain chemical. 
The mean levels, standard deviations, and sample sizes for the two samples studied were as 
follows: 


Sample n x s 


With condition 35 8.5 5.5 
Without condition 40 4.8 3.6 


What should the researcher conclude on the basis of these results? Let œ = .05. 
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7.3.10 Researchers wished to know if they could conclude that two populations of infants differ with respect 
to mean age at which they walked alone. The following data (ages in months) were collected: 


Sample from population A: 9.5, 10.5, 9.0, 9.75, 10.0, 13.0, 
10.0, 13.5, 10.0, 9.5, 10.0, 9.75 

Sample from population B: 12.5, 9.5, 13.5, 13.75, 12.0, 13.75, 
12.5, 9.5, 12.0, 13.5, 12.0, 12.0 


What should the researchers conclude? Let a = .05. 


7.3.11 Does sensory deprivation have an effect on a person's alpha-wave frequency? Twenty volunteer 
subjects were randomly divided into two groups. Subjects in group A were subjected to a 10-day 
period of sensory deprivation, while subjects in group B served as controls. At the end of the 
experimental period, the alpha-wave frequency component of subjects” electroencephalograms was 
measured. The results were as follows: 


Group A: 10.2, 9.5, 10.1, 10.0, 9.8, 10.9, 11.4, 10.8, 9.7, 10.4 
Group B: 11.0, 11.2, 10.1, 11.4, 11.7, 11.2, 10.8, 11.6, 10.9, 10.9 


Let a = .05. 


7.3.12 Can we conclude that, on the average, lymphocytes and tumor cells differ in size? The following are 
the cell diameters (um) of 40 lymphocytes and 50 tumor cells obtained from biopsies of tissue from 
patients with melanoma: 


Lymphocytes 
9.0 9.4 4.7 4.8 8.9 4.9 8.4 5.9 
6.3 51 5.0 3.5 7.8 10.4 8.0 8.0 
8.6 7.0 6.8 7.1 5.7 7.6 6.2 7.1 
7.4 8.7 4.9 7.4 6.4 7.1 6.3 8.8 
8.8 5.2 7.1 5.3 4.7 8.4 6.4 8.3 


Tumor Cells 


12.6 14.6 162 239 233 17.1 200 21.0 19.1 19.4 
16.7 15.9 15.8 16.0 17.9 13.4 19.1 16.6 18.9 18.7 
20.0 17.8 139 224 13.9 18.3 22.8 13.0 17.9 15.2 
17.7 15.1 16.9 164 228 19.4 19.6 18.4 182 20.7 
16.3 17.7 18.1 24.3 11.2 19.5 18.6 16.4 16.1 21.5 


Let o — .05. 


7.4 PAIRED COMPARISONS 


In our previous discussion involving the difference between two population means, it was 
assumed that the samples were independent. A method frequently employed for assessing 
the effectiveness of a treatment or experimental procedure is one that makes use of related 
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Observations resulting from nonindependent samples. A hypothesis test based on this type 
of data is known as a paired comparisons test. 


Reasons for Pairing It frequently happens that true differences do not exist 
between two populations with respect to the variable of interest, but the presence of 
extraneous sources of variation may cause rejection of the null hypothesis of no difference. 
On the other hand, true differences also may be masked by the presence of extraneous factors. 

Suppose, for example, that we wish to compare two sunscreens. There are at least two 
ways in which the experiment may be carried out. One method would be to select a simple 
random sample of subjects to receive sunscreen A and an independent simple random 
sample of subjects to receive sunscreen B. We send the subjects out into the sunshine for a 
specified length of time, after which we will measure the amount of damage from the rays 
of the sun. Suppose we employ this method, but inadvertently, most of the subjects 
receiving sunscreen A have darker complexions that are naturally less sensitive to sunlight. 
Let us say that after the experiment has been completed we find that subjects receiving 
sunscreen A had less sun damage. We would not know if they had less sun damage because 
sunscreen А was more protective than sunscreen B or because the subjects were naturally 
less sensitive to the sun. 

A better way to design the experiment would be to select just one simple random 
sample of subjects and let each member of the sample receive both sunscreens. We could, 
for example, randomly assign the sunscreens to the left or the right side of each subject's 
back with each subject receiving both sunscreens. After a specified length of exposure to 
the sun, we would measure the amount of sun damage to each half of the back. If the half of 
the back receiving sunscreen A tended to be less damaged, we could more confidently 
attribute the result to the sunscreen, since in each instance both sunscreens were applied to 
equally pigmented skin. 

The objective in paired comparisons tests is to eliminate a maximum number of 
sources of extraneous variation by making the pairs similar with respect to as many 
variables as possible. 

Related or paired observations may be obtained in a number of ways. The same 
subjects may be measured before and after receiving some treatment. Litter mates of the same 
sex may be assigned randomly to receive either a treatment or a placebo. Pairs of twins or 
siblings may be assigned randomly to two treatments in such a way that members of a single 
pair receive different treatments. In comparing two methods of analysis, the material to be 
analyzed may be divided equally so that one-half is analyzed by one method and one-half is 
analyzed by the other. Or pairs may be formed by matching individuals on some characteris- 
tic, for example, digital dexterity, which is closely related to the measurement of interest, say, 
posttreatment scores on some test requiring digital manipulation. 

Instead of performing the analysis with individual observations, we use d;, the 
difference between pairs of observations, as the variable of interest. 

When the n sample differences computed from the n pairs of measurements 
constitute a simple random sample from a normally distributed population of differences, 
the test statistic for testing hypotheses about the population mean difference uy is 


d— Ha, 


за 


f= (7.4.1) 
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where d is the sample mean difference, Иа, is the hypothesized population mean 
difference, 54 = s4/ /n, п is the number of sample differences, and s; is the standard 
deviation of the sample differences. When Но is true, the test statistic is distributed as 
Student's t with n — 1 degrees of freedom. 

Although to begin with we have two samples—say, before levels and after levels— 
we do not have to worry about equality of variances, as with independent samples, since our 
variable is the difference between readings in the same individual, or matched individuals, 
and, hence, only one variable is involved. The arithmetic involved in performing a paired 
comparisons test, therefore, is the same as for performing a test involving a single sample 
as described in Section 7.2. 

The following example illustrates the procedures involved in a paired comparisons 
test. 


EXAMPLE 7.4.1 


John M. Morton et al. (A-14) examined gallbladder function before and after fundopli- 
cation—a surgery used to stop stomach contents from flowing back into the esophagus 
(reflux)—in patients with gastroesophageal reflux disease. The authors measured 
gallbladder functionality by calculating the gallbladder ejection fraction (GBEF) before 
and after fundoplication. The goal of fundoplication is to increase GBEF, which is 
measured as a percent. The data are shown in Table 7.4.1. We wish to know if these 
data provide sufficient evidence to allow us to conclude that fundoplication increases 
GBEF functioning. 


Solution: We will say that sufficient evidence is provided for us to conclude that the 
fundoplication is effective if we can reject the null hypothesis that the 
population mean change ид is different from zero in the appropriate direc- 
tion. We may reach a conclusion by means of the ten-step hypothesis testing 
procedure. 


1. Data. The data consist of the GBEF for 12 individuals, before and after 
fundoplication. We shall perform the statistical analysis on the differ- 
ences in preop and postop GBEF. We may obtain the differences in one 
of two ways: by subtracting the preop percents from the postop percents 
or by subtracting the postop percents from the preop percents. Let us 


TABLE 7.4.1 Gallbladder Function in Patients with Presentations of 
Gastroesophageal Reflux Disease Before and After Treatment 


Preop (95) 
Postop (96) 


22 63.3 96 9.2 3.1 50 33 69 64 18.8 0 34 
63.5 915 59 378 10.1 19.6 41 87.8 86 55 88 40 


Source: John M. Morton, Steven P. Bowers, Tananchai А. Lucktong, Samer Mattar, W. Alan Bradshaw, Kevin E. 
Behrns, Mark J. Koruda, Charles A. Herbst, William McCartney, Raghuveer K. Halkar, C. Daniel Smith, and 
Timothy M. Farrell, "Gallbladder Function Before and After Fundoplication," Journal of Gastrointestinal 
Surgery, 6 (2002), 806-811. 
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obtain the differences by subtracting the preop percents from the postop 
percents. The d; — postop — preop differences are: 


41.5, 28.2, —37.0, 28.6, 7.0, —30.4, 8.0, 18.8, 22.0, 36.2, 88.0, 6.0 


. Assumptions. The observed differences constitute a simple random 


sample from a normally distributed population of differences that could 
be generated under the same circumstances. 


. Hypotheses. The way we state our null and alternative hypotheses 


must be consistent with the way in which we subtract measurements to 
obtain the differences. In the present example, we want to know if we 
can conclude that the fundoplication is useful in increasing GBEF 
percentage. If it is effective in improving GBEF, we would expect the 
postop percents to tend to be higher than the preop percents. If, 
therefore, we subtract the preop percents from the postop percents 
(postop — preop), we would expect the differences to tend to be 
positive. Furthermore, we would expect the mean of a population 
of such differences to be positive. So, under these conditions, asking if 
we can conclude that the fundoplication is effective is the same as 
asking if we can conclude that the population mean difference is 
positive (greater than zero). 
The null and alternative hypotheses are as follows: 


Но: ua < 0 
НА: ца 0 


If we had obtained the differences by subtracting the postop percents from 
the preop weights (preop — postop), our hypotheses would have been 
Ho: Pa = 0 
H А: Иа < 0 


If the question had been such that а two-sided test was indicated, the 
hypotheses would have been 


Но: иа = 0 
НА: Иа 70 


regardless of the way we subtracted to obtain the differences. 


. Test statistic. The appropriate test statistic is given by Equation 7.4.1. 
. Distribution of test statistic. If the null hypothesis is true, the test 


statistic is distributed as Student's г with n — 1 degrees of freedom. 


. Decision rule. Leto = .05. The critical value of t 15 1.7959. Reject Ho if 


computed f is greater than or equal to the critical value. The rejection and 
nonrejection regions are shown in Figure 7.4.1. 
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а = .05 


| 
0 1.7959 t 
n 


Y Y 


Nonrejection region Rejection region 


FIGURE 7.4.1 Rejection and nonrejection regions for 
Example 7.4.1. 


7. Calculation of test statistic. From the n — 12 differences d; we 
compute the following descriptive measures: 


5 — 54 (415) + (28.2) + (37.0) +--+ (6.0) 2169 


n 12 12 


— 18.075 
 У(а-4 пу – (Y di)?  12(15669.49) - (216.9)? 
п—1 n(n — 1) (12)(11) 
18.075 —0 18.075 


ро 
\/1068.0930/12 9.4344 


= 1068.0930 


= 1.9159 


8. Statistical decision. Reject Но, since 1.9159 is in the rejection region. 


Paired T-Test and CI: C2, C1 


Paired T for C2 - C1 


EZ 
cl 
Difference 


95% lower bound for mean difference: 1.1319 
T-Test of mean difference = 0 (vs > 0): T-Value = 1.92 P-Value = 


0.041 


N Mean StDev SE Mean 
12 56.6083 27.8001 8.0252 
12 38.5333 30.0587 8.6772 
12 18.0750 32.6817 9.4344 


FIGURE 7.4.2 MINITAB procedure and output for paired comparisons test, Example 7.4.1 
(data in Table 7.4.1). 
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9. Conclusion. We may conclude that the fundoplication procedure incre- 
ases GBEF functioning. 


10. p value. For this test, .025 < p < .05, since 1.7959 < 1.9159 < 2.2010. 
MINITAB provides the exact p value as .041 (Figure 7.4.2). = 


A Confidence Interval for jj, А 95 percent confidence interval for ug may be 
obtained as follows: 


d+ Й (а/2)5а 

18.075 + 2.20104/1068.0930/12 
18.075 + 20.765 

(—2.690, 38.840) 


The Use of 2 If, in the analysis of paired data, the population variance of the 
differences is known, the appropriate test statistic is 


_d— ма 
оа/уп 


It is unlikely that o; will be known in practice. 

If the assumption of normally distributed d;'s cannot be made, the central limit 
theorem may be employed if n is large. In such cases, the test statistic is Equation 7.4.2, 
with 5; used to estimate од when, as is generally the case, the latter is unknown. 


д (7.4.2) 


Disadvantages Тһе use of the paired comparisons test is not without its problems. 
If different subjects are used and randomly assigned to two treatments, considerable time 
and expense may be involved in our trying to match individuals on one or more relevant 
variables. A further price we pay for using paired comparisons is a loss of degrees of 
freedom. If we do not use paired observations, we have 2n — 2 degrees of freedom 
available as compared to п — 1 when we use the paired comparisons procedure. 

In general, in deciding whether or not to use the paired comparisons procedure, one 
should be guided by the economics involved as well as by a consideration of the gains to be 
realized in terms of controlling extraneous variation. 


Alternatives If neither z nor t is an appropriate test statistic for use with available 
data, one may wish to consider using some nonparametric technique to test a hypothesis 
about a median difference. The sign test, discussed in Chapter 13, is a candidate for use in 
such cases. 


EXERCISES 


In the following exercises, carry out the ten-step hypothesis testing procedure at the specified 
significance level. For each exercise, as appropriate, explain why you chose a one-sided test or a two- 
sided test. Discuss how you think researchers or clinicians might use the results of your hypothesis 
test. What clinical or research decisions or actions do you think would be appropriate in light of the 
results of your test? 


7.4.1 


7.4.2 
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Ellen Davis Jones (A-15) studied the effects of reminiscence therapy for older women with 
depression. She studied 15 women 60 years or older residing for 3 months or longer in an assisted 
living long-term care facility. For this study, depression was measured by the Geriatric Depression 
Scale (GDS). Higher scores indicate more severe depression symptoms. The participants received 
reminiscence therapy for long-term care, which uses family photographs, scrapbooks, and personal 
memorabilia to stimulate memory and conversation among group members. Pre-treatment and post- 
treatment depression scores are given in the following table. Can we conclude, based on these data, 
that subjects who participate in reminiscence therapy experience, on average, a decline in GDS 
depression scores? Let o — .01. 


Pre-GDS: 12 10 16 2 12 18 11 16 16 10 14 21 9 19 20 
Post-GDS: 11 10 11 3 9 13 8 14 16 10 12 22 9 16 18 
Source: Data provided courtesy of Ellen Davis Jones, N.D., R.N., FNP-C. 


Beney et al. (A-16) evaluated the effect of telephone follow-up on the physical well-being dimension 
of health-related quality of life in patients with cancer. One of the main outcome variables was 
measured by the physical well-being subscale of the Functional Assessment of Cancer Therapy 
Scale-General (FACT-G). A higher score indicates higher physical well-being. The following table 
shows the baseline FACT-G score and the follow-up score to evaluate the physical well-being during 
the 7 days after discharge from hospital to home for 66 patients who received a phone call 48—72 
hours after discharge that gave patients the opportunity to discuss medications, problems, and advice. 
Is there sufficient evidence to indicate that quality of physical well-being significantly decreases in 
the first week of discharge among patients who receive a phone call? Let a = .05. 


Baseline Follow-up Baseline Follow-up 
Subject || FACT-G FACT-G Subject ЕАСТ-С FACT-G 
1 16 19 34 223 14 
2 26 19 35 21 17 
3 13 9 36 14 22 
4 20 23 37 23 22 
5 22 25 38 19 16 
6 21 20 39 19 15 
7 20 10 40 18 23 
8 15 20 41 20 21 
9 25 22 42 18 11 
10 20 18 43 22 22 
11 11 6 44 7 17 
12 22 21 45 23 9 
13 18 17 46 19 16 
14 21 13 47 17 16 
15 25 25 48 22 20 
16 17 21 49 19 23 
17 26 22 50 5 17 
18 18 22 51 22 17 
19 7 9 52 12 6 
20 25 24 53 19 19 
21 22 15 54 17 20 
22 15 9 55 7 6 


(Continued ) 
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7.4.3 


7.4.4 


Baseline Follow-up Baseline Follow-up 
Subject ЕАСТ-С FACT-G Subject ЕАСТ-С FACT-G 
23 19 7 56 27 10 
24 23 20 57 22 16 
25 19 19 58 16 14 
26 21 24 59 26 24 
27 24 23 60 17 19 
28 21 15 61 23 22 
29 28 27 62 23 23 
30 18 26 63 13 3 
31 25 26 64 24 22 
32 25 26 65 17 21 
33 28 28 66 22 21 


Source: Data provided courtesy of Johnny Beney, Ph.D. and E. Beth Devine, Pharm.D., 
M.B.A. et al. 


The purpose of an investigation by Morley et al. (A-17) was to evaluate the analgesic effectiveness 
of a daily dose of oral methadone in patients with chronic neuropathic pain syndromes. The 
researchers used a visual analogue scale (0-100 mm, higher number indicates higher pain) ratings 
for maximum pain intensity over the course of the day. Each subject took either 20mg of 
methadone or a placebo each day for 5 days. Subjects did not know which treatment they were 
taking. The following table gives the mean maximum pain intensity scores for the 5 days on 
methadone and the 5 days on placebo. Do these data provide sufficient evidence, at the .05 level of 
significance, to indicate that in general the maximum pain intensity is lower on days when 
methadone is taken? 


Subject Methadone Placebo 


1 29.8 57.2 

2 73.0 69.8 

3 98.6 98.2 

4 58.8 62.4 

5 60.6 67.2 

6 57.2 70.6 

7 57.2 67.8 

8 89.2 95.6 Source: John S. Morley, John Bridson, Tim P. Nash, John B. 

9 97.0 98.4 Miles, Sarah White, and Matthew K. Makin, “Low-Dose 
10 49.8 63.2 Methadone Has an Analgesic Effect in Neuropathic Pain: 
11 37.0 63.6 A Double-Blind Randomized Controlled Crossover Trial," 


Palliative Medicine, 17 (2003), 576—587. 


Woo and McKenna (A-18) investigated the effect of broadband ultraviolet B (UVB) therapy and 
topical calcipotriol cream used together on areas of psoriasis. One of the outcome variables is the 
Psoriasis Area and Severity Index (PASI). The following table gives the PASI scores for 20 
subjects measured at baseline and after eight treatments. Do these data provide sufficient 
evidence, at the .01 level of significance, to indicate that the combination therapy reduces 
PASI scores? 
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After 8 
Subject | Baseline Treatments 
1 5.9 5.2 
2 7.6 12.2 
3 12.8 4.6 
4 16.5 4.0 
5 6.1 0.4 
6 14.4 3.8 
7 6.6 1.2 
8 5.4 3.1 
9 9.6 3:5 
10 11.6 4.9 
11 11.1 11.1 
12 15.6 8.4 
13 6.9 5.8 
14 15.2 5.0 
15 21.0 6.4 
16 5.9 0.0 
17 10.0 2.7 
18 12:2 5.1 
19 20.2 4.8 
20 6.2 4.2 


Source: Data provided courtesy of W. K. Woo, M.D. 


7.4.5 One of the purposes of an investigation by Porcellini et al. (A-19) was to investigate the effect on CD4 
T cell count of administration of intermittent interleukin (IL-2) in addition to highly active 
antiretroviral therapy (HAART). The following table shows the CD4 T cell count at baseline and 
then again after 12 months of HAART therapy with IL-2. Do the data show, at the .05 level, a 
significant change in CD4 T cell count? 


Subject 1 2 3 4 5 6 7 


CD4 T cell count at entry (x 10°/L) 173 58 103 181 105 301 169 
CD4 T cell count at end lof follow-up 257 108 315 362 141 549 369 
(x 10°/L) 


Source: Simona Procellini, Giuliana Vallanti, Silvia Nozza, Guido Poli, Adraino Lazzarin, Guiseppe Tabussi, and 
Antonio Grassia, “Improved Thymopoietic Potential in Aviremic HIV-Infected Individuals with HAART by 
Intermittent IL-2 Administration," AIDS, 17 (2003), 1621-1630. 


7.5 HYPOTHESIS TESTING: A SINGLE 
POPULATION PROPORTION 


Testing hypotheses about population proportions is carried out in much the same way as for 
means when the conditions necessary for using the normal curve are met. One-sided or 
two-sided tests may be made, depending on the question being asked. When a sample 
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sufficiently large for application of the central limit theorem as discussed in Section 5.5 is 
available for analysis, the test statistic is 


Poo 
n 


which, when Но is true, is distributed approximately as the standard normal. 


(7.5.1) 


EXAMPLE 7.5.1 


Wagenknecht et al. (A-20) collected data on a sample of 301 Hispanic women living in San 
Antonio, Texas. One variable of interest was the percentage of subjects with impaired 
fasting glucose (IFG). IFG refers to a metabolic stage intermediate between normal glucose 
homeostasis and diabetes. In the study, 24 women were classified in the IFG stage. The 
article cites population estimates for IFG among Hispanic women in Texas as 6.3 percent. 
Is there sufficient evidence to indicate that the population of Hispanic women in San 
Antonio has a prevalence of IFG higher than 6.3 percent? 


Solution: 


1. Data. The data are obtained from the responses of 301 individuals of 
which 24 possessed the characteristic of interest; that is, p = 24/301 
= .080. 


2. Assumptions. The study subjects may be treated as a simple random 
sample from a population of similar subjects, and the sampling distri- 
bution of p is approximately normally distributed in accordance with the 
central limit theorem. 

3. Hypotheses. 

Ho: p < .063 
Ha: p > .063 


We conduct the test at the point of equality. The conclusion we reach 
will be the same as we would reach if we conducted the test using any 
other hypothesized value of p greater than .063. If Но is true, p = .063 
and the standard error ор = y (.063)(.937)/301. Note that we use the 
hypothesized value of p in computing o5. We do this because the entire 
test is based on the assumption that the null hypothesis is true. To 
use the sample proportion, р, in computing ор would not be consistent 
with this concept. 


4. Test statistic. The test statistic is given by Equation 7.5.1. 


5. Distribution of test statistic. If the null hypothesis is true, the test 
statistic is approximately normally distributed with a mean of zero. 


6. Decision rule. Let o = .05. The critical value of z is 1.645. Reject Но if 
the computed z is > 1.645. 
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7. Calculation of test statistic. 


.080 — .063 


(.063) (.937) 
301 


8. Statistical decision. Do not reject Не since 1.21 « 1.645. 


9. Conclusion. We cannot conclude that in the sampled population the 
proportion who are IFG is higher than 6.3 percent. 


10. p value. p — .1131. ш 


Tests involving a single proportion can be carried out using a variety of computer 
programs. Outputs from MINITAB and NCSS, using the data from Example 7.5.1, are 
shown in Figure 7.5.1. It should be noted that the results will vary slightly, because of 
rounding errors, if calculations are done by hand. It should also be noted that some 
programs, such as NCSS, use a continuity correction in calculating the z-value, and 
therefore the test statistic values and corresponding p values differ slightly from the 
MINITAB output. 


MINITAB Output 


Test and CI for One Proportion 
Test of p = 0.063 vs p > 0.063 
95$ Lower 


Sample X N Sample p Bound 
1 24 301 0.079734 0.054053 


Using the normal approximation. 


NCSS Output 


Normal Approximation using (PO) 


Alternative Z-Value Prob Decision 
Hypothesis Level (5%) 
Р<>РО 1.0763 0.281780 Accept НО 
P«PO 1.0763 0.859110 Accept НО 
Р>РО 1.0763 0.140890 Accept НО 


FIGURE 7.5.1 MINITAB and partial NCSS output for the data in Example 7.5.1. 
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EXERCISES 


7.5.1 


7.5.2 


7.5.3 


7.5.4 


7.5.5 


7.5.6 


For each of the following exercises, carry out the ten-step hypothesis testing procedure at the 
designated level of significance. For each exercise, as appropriate, explain why you chose a one-sided 
test or a two-sided test. Discuss how you think researchers or clinicians might use the results of your 
hypothesis test. What clinical or research decisions or actions do you think would be appropriate in 
light of the results of your test? 


Jacquemyn et al. (A-21) conducted a survey among gynecologists-obstetricians in the 
Flanders region and obtained 295 responses. Of those responding, 90 indicated that they had 
performed at least one cesarean section on demand every year. Does this study provide sufficient 
evidence for us to conclude that less than 35 percent of the gynecologists-obstetricians in the Flanders 
region perform at least one cesarean section on demand each year? Let a = .05. 


Inan article in the journal Health and Place, Hui and Bell (A-22) found that among 2428 boys ages 
7 to 12 years, 461 were overweight or obese. On the basis of this study, can we conclude that more 
than 15 percent of the boys ages 7 to 12 in the sampled population are obese or overweight? Let 
а = .05. 


Becker et al. (A-23) conducted a study using а sample of 50 ethnic Fijian women. The women 
completed a self-report questionnaire on dieting and attitudes toward body shape and change. 
The researchers found that five of the respondents reported at least weekly episodes of binge 
eating during the previous 6 months. Is this sufficient evidence to conclude that less than 20 
percent of the population of Fijian women engage in at least weekly episodes of binge eating? 
Let a = .05. 


The following questionnaire was completed by a simple random sample of 250 gynecologists. The 
number checking each response is shown in the appropriate box. 


1. When you have a choice, which procedure do you prefer for obtaining samples of endometrium? 


(a) Dilation and curettage |175 
(b) Vobra aspiration | 75 


2. Have you seen one or more pregnant women during the past year whom you knew to have 
elevated blood lead levels? 
(a) Yes [25 
(b) No |225 


3. Do you routinely acquaint your pregnant patients who smoke with the suspected hazards of 
smoking to the fetus? 
(a) Yes 1238 
(b) No |12 


Can we conclude from these data that in the sampled population more than 60 percent prefer dilation 
and curettage for obtaining samples of endometrium? Let o — .01. 


Refer to Exercise 7.5.4. Can we conclude from these data that in the sampled population fewer than 
15 percent have seen (during the past year) one or more pregnant women with elevated blood lead 
levels? Let a = .05. 


Refer to Exercise 7.5.4. Can we conclude from these data that more than 90 percent acquaint 
their pregnant patients who smoke with the suspected hazards of smoking to the fetus? Let 
а = .05. 
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7.6 HYPOTHESIS TESTING: 
THE DIFFERENCE BETWEEN TWO 
POPULATION PROPORTIONS 


The most frequent test employed relative to the difference between two population 
proportions is that their difference is zero. It is possible, however, to test that the 
difference is equal to some other value. Both one-sided and two-sided tests may be 
made. 

When the null hypothesis to be tested is р; — p) = 0, we are hypothesizing that the 
two population proportions are equal. We use this as justification for combining the results 
of the two samples to come up with a pooled estimate of the hypothesized common 
proportion. If this procedure is adopted, one computes 


where x, and x» are the numbers in the first and second samples, respectively, possessing 
the characteristic of interest. This pooled estimate of p = p, = р» is used in computing 


Орр» the estimated standard error of the estimator, as follows: 


E үз - p), РО - p) 1 


П] n» 
The test statistic becomes 


= (ĝi = Po) — (р = Pro 


Opp, 


(7.6.2) 


which is distributed approximately as the standard normal if the null hypothesis is 
true. 


EXAMPLE 7.6.1 


Noonan syndrome is a genetic condition that can affect the heart, growth, blood clotting, 
and mental and physical development. Noonan et al. (A-24) examined the stature of men 
and women with Noonan syndrome. The study contained 29 male and 44 female adults. 
One of the cut-off values used to assess stature was the third percentile of adult height. 
Eleven of the males fell below the third percentile of adult male height, while 24 of the 
females fell below the third percentile of female adult height. Does this study provide 
sufficient evidence for us to conclude that among subjects with Noonan syndrome, females 
are more likely than males to fall below the respective third percentile of adult height? Let 
о = .05. 
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Solution: 


ль 


. Data. The data consist of information regarding the height status of 


Noonan syndrome males and females as described in the statement of 
the example. 


. Assumptions. We assume that the patients in the study constitute 


independent simple random samples from populations of males and 
females with Noonan syndrome. 


. Hypotheses. 
Но: Pp < рм Of рес Pm 20 
НА Ре? рм Of ре = рм 0 
where pp is the proportion of females below the third percentile of 
female adult height and py is the proportion of males below the third 
percentile of male adult height. 

. Test statistic. The test statistic is given by Equation 7.6.2. 

. Distribution of test statistic. If the null hypothesis is true, the test 
statistic is distributed approximately as the standard normal. 

. Decision rule. Let o = .05. The critical value of z is 1.645. Reject Но if 
computed z is greater than 1.645. 

. Calculation of test statistic. From the sample data we compute 
Pp = 24/44 = 545, фу = 11/29 = 379, and p=(24+11)/(44+29) = 
.479. The computed value of the test statistic, then, is 

= (.545 — .379) = 
кле Н (.479)(.521) 
44 29 

. Statistical decision. Fail to reject Но since 1.39 < 1.645. 

. Conclusion. In the general population of adults with Noonan syndrome 
there may be no difference in the proportion of males and females who 
have heights below the third percentile of adult height. 

. p value. For this test p = .0823. ш 


Tests involving two proportions, using the data from Example 7.6.1, can be carried 
out with a variety of computer programs. Outputs from MINITAB and NCSS are shown in 
Figure 7.6.1. Again, it should be noted that, because of rounding errors, the results will vary 
slightly if calculations are done by hand. 
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MINITAB Output 


Test and CI for Two Proportions 


Sample X N Sample p 
1 24 44 0.545455 
2 11 29 0.379310 


Difference = (1) - р (2) 


Estimate for difference: 0.166144 
95% lower bound for difference: -0.0267550 


Test for difference = 0 (vs > 0): 7 = 1.39 P-Value = 0.082 


NCSS Output 


Test Test Test Conclude H1 
Name Statistic's Statistic at 596 

Distribution Value Significance? 
Z-Test Normal 1.390 No 


FIGURE 7.6.1 МІМІТАВ and partial NCSS output for the data in Example 7.6.1. 


EXERCISES 


In each of the following exercises use the ten-step hypothesis testing procedure. For each 
exercise, as appropriate, explain why you chose a one-sided test or a two-sided test. Discuss 
how you think researchers or clinicians might use the results of your hypothesis test. What clinical 
or research decisions or actions do you think would be appropriate in light of the results of your 
test? 


7.6.1 Ho et al. (A-25) used telephone interviews of randomly selected respondents in Hong Kong to obtain 
information regarding individuals” perceptions of health and smoking history. Among 1222 current 
male smokers, 72 reported that they had “poor” or “very poor” health, while 30 among 282 former 
male smokers reported that they had “poor” or “very poor” health. Is this sufficient evidence to allow 
one to conclude that among Hong Kong men there is a difference between current and former 
smokers with respect to the proportion who perceive themselves as having “poor” and “very poor” 
health? Let a = .01. 


7.6.2 Landolt et al. (A-26) examined rates of posttraumatic stress disorder (PTSD) in mothers and fathers. 
Parents were interviewed 5 to 6 weeks after an accident or a new diagnosis of cancer or diabetes 
mellitus type I for their child. Twenty-eight of the 175 fathers interviewed and 43 of the 180 mothers 
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7.6.3 


7.6.4 


interviewed met the criteria for current PTSD. Is there sufficient evidence for us to conclude that 
fathers are less likely to develop PTSD than mothers when a child is traumatized by an accident, 
cancer diagnosis, or diabetes diagnosis? Let o — .05. 


In a Kidney International article, Avram et al. (A-27) reported on a study involving 529 hemodialysis 
patients and 326 peritoneal dialysis patients. They found that at baseline 249 subjects in the 
hemodialysis treatment group were diabetic, while at baseline 134 of the subjects in the peritoneal 
dialysis group were diabetic. Is there a significant difference in diabetes prevalence at baseline 
between the two groups of this study? Let a = .05. What does your finding regarding sample 
significance imply about the populations of subjects? 


In a study of obesity the following results were obtained from samples of males and females between 
the ages of 20 and 75: 


n Number Overweight 
Males 150 21 
Females 200 48 


Can we conclude from these data that in the sampled populations there is a difference in the 
proportions who are overweight? Let o — .05. 


7.7 HYPOTHESIS TESTING: A SINGLE 
POPULATION VARIANCE 


In Section 6.9 we examined how it is possible to construct a confidence interval for the 
variance of a normally distributed population. The general principles presented in that 
section may be employed to test a hypothesis about a population variance. When the data 
available for analysis consist of a simple random sample drawn from a normally 
distributed population, the test statistic for testing hypotheses about a population 
variance is 


x! = (и – Ds e? (7.7.1) 
which, when Но is true, is distributed as 2 with n — 1 degrees of freedom. 


EXAMPLE 7.7.1 


The purpose of a study by Wilkins et al. (A-28) was to measure the effectiveness of 
recombinant human growth hormone (rhGH) on children with total body surface area burns 
> 40 percent. In this study, 16 subjects received daily injections at home of rhGH. At 
baseline, the researchers wanted to know the current levels of insulin-like growth factor 
(IGF-I) prior to administration of rhGH. The sample variance of IGF-I levels (in ng/ml) was 
670.81. We wish to know if we may conclude from these data that the population variance 
is not 600. 
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Solution: 

1. Data. See statement in the example. 

2. Assumptions. The study sample constitutes a simple random sample 
from a population of similar children. The IGF-I levels are normally 
distributed. 

3. Hypotheses. 

Ho: o? — 600 
Ha: о? 4 600 

4. Test statistic. The test statistic is given by Equation 7.7.1. 

5. Distribution of test statistic. When the null hypothesis is true, the test 
statistic is distributed as x? with n — 1 degrees of freedom. 

6. Decision rule. Let o — .05. Critical values of x? are 6.262 and 27.488. 
Reject Но unless the computed value of the test statistic is between 
6.262 and 27.488. The rejection and nonrejection regions are shown in 
Figure 7.7.1. 

7. Calculation of test statistic. 

, 15(67081) _ 16.77 
Хо” 

8. Statistical decision. Do not reject Но since 6.262 < 16.77 < 27.488. 

9. Conclusion. Based on these data we are unable to conclude that the 
population variance is not 600. 

10. p value. The determination of the p value for this test is complicated by 
the fact that we have a two-sided test and an asymmetric sampling 
distribution. When we have a two-sided test and a symmetric sampling 
distribution such as the standard normal or І, we may, as we have 
seen, double the one-sided p value. Problems arise when we attempt to 

.025 
.025 
0 6202 27.488 x 
Rejection region Nonrejection region Rejection region 


FIGURE 7.7.1 


Rejection and nonrejection regions for Example 7.7.1. 
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do this with an asymmetric sampling distribution such as the chi-square 
distribution. In this situation the one-sided p value is reported along with 
the direction of the observed departure from the null hypothesis. In fact, 
this procedure may be followed in the case of symmetric sampling 
distributions. Precedent, however, seems to favor doubling the one-sided 
p value when the test is two-sided and involves a symmetric sampling 
distribution. 

For the present example, then, we may report the p value as follows: 
p > .05 (two-sided test). A population variance greater than 600 is 
suggested by the sample data, but this hypothesis is not strongly 
supported by the test. 

If the problem is stated in terms of the population standard deviation, 
one may square the sample standard deviation and perform the test as 
indicated above. B 


One-Sided Tests Although this was an example of a two-sided test, one-sided tests 
may also be made by logical modification of the procedure given here. 


For Ha: о? > 07, reject Но if computed x? > хі, 
For Ha: о? < оў, reject Ho if computed x? < x2 
Tests involving a single population variance can be carried out using MINITAB 
software. Most other statistical computer programs lack procedures for carrying out these 


tests directly. The output from MINITAB, using the data from Example 7.7.1, is shown in 
Figure 7.7.2. 


Test and СІ for One Variance 


Statistics 


N StDev Variance 
16 25.9 671 


95% Confidence Intervals 
CTI. Lor CI for 
Method StDev Variance 


Standard (19.1, 40.1) (366, 1607) 


Tests 


Method Chi-Square 
Standard 16.77 


FIGURE 7.7.2 MINITAB output for the data in Example 7.7.1. 
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EXERCISES 


7.7.1 


7.7.2 


7.7.3 


7.7.4 


7.7.5 


7.7.6 


1717 


In each of the following exercises, carry out the ten-step testing procedure. For each exercise, as 
appropriate, explain why you chose a one-sided test or a two-sided test. Discuss how you think 
researchers or clinicians might use the results of your hypothesis test. What clinical or research 
decisions or actions do you think would be appropriate in light of the results of your test? 


Recall Example 7.2.3, where Nakamura et al. (A-1) studied subjects with acute medial collateral 
ligament injury (MCL) with anterior cruciate ligament tear (ACL). The ages of the 17 subjects were: 


31, 26, 21, 15, 26, 16, 19, 21, 28, 27, 22, 20, 25, 31, 20, 25, 15 


Use these data to determine if there is sufficient evidence for us to conclude that in a population of 
similar subjects, the variance of the ages of the subjects is not 20 years. Let о = .01. 


Robinson et al. (A-29) studied nine subjects who underwent baffle procedure for transposition of the 
great arteries (TGA). At baseline, the systemic vascular resistance (SVR) (measured in WU x m?) 
values at rest yielded a standard deviation of 28. Can we conclude from these data that the SVR 
variance of a population of similar subjects with TGA is not 700? Let œ = .10. 


Vital capacity values were recorded for a sample of 10 patients with severe chronic airway 
obstruction. The variance of the 10 observations was .75. Test the null hypothesis that the population 
variance is 1.00. Let a = .05. 


Hemoglobin (g percent) values were recorded for a sample of 20 children who were part of a study of 
acute leukemia. The variance of the observations was 5. Do these data provide sufficient evidence to 
indicate that the population variance is greater than 4? Let o — .05. 


A sample of 25 administrators of large hospitals participated in a study to investigate the nature and 
extent of frustration and emotional tension associated with the job. Each participant was given a test 
designed to measure the extent of emotional tension he or she experienced as a result of the duties and 
responsibilities associated with the job. The variance of the scores was 30. Can it be concluded from 
these data that the population variance is greater than 25? Let а = .05. 


In a study in which the subjects were 15 patients suffering from pulmonary sarcoid disease, blood gas 
determinations were made. The variance of the Pao; (mm Hg) values was 450. Test the null 
hypothesis that the population variance is greater than 250. Let a = .05. 


Analysis of the amniotic fluid from a simple random sample of 15 pregnant women yielded the 
following measurements on total protein (grams per 100 ml) present: 


.69, 1.04, .39, .37, .64, .73, .69, 1.04, 
.83, 1.00, .19, .61, .42, .20, .79 


Do these data provide sufficient evidence to indicate that the population variance is greater than .05? 
Let о = .05. What assumptions are necessary? 


7.8 HYPOTHESIS TESTING: THE RATIO 
OF TWO POPULATION VARIANCES 


As we have seen, the use of the 7 distribution in constructing confidence intervals and in 
testing hypotheses for the difference between two population means assumes that the 
population variances are equal. As a rule, the only hints available about the magnitudes of 
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the respective variances are the variances computed from samples taken from the 
populations. We would like to know if the difference that, undoubtedly, will exist between 
the sample variances is indicative of a real difference in population variances, or if the 
difference is of such magnitude that it could have come about as a result of chance alone 
when the population variances are equal. 

Two methods of chemical analysis may give the same results on the average. It may 
be, however, that the results produced by one method are more variable than the results of 
the other. We would like some method of determining whether this is likely to be true. 


Variance Ratio Test Decisions regarding the comparability of two population 
variances are usually based on the variance ratio test, which is a test of the null hypothesis 
that two population variances are equal. When we test the hypothesis that two population 
variances are equal, we are, in effect, testing the hypothesis that their ratio is equal to 1. 

We learned in the preceding chapter that, when certain assumptions are met, the 
quantity (57/01) / (52/03) is distributed as F with n; — 1 numerator degrees of freedom and 
nz — | denominator degrees of freedom. If we are hypothesizing that о? == оз, we assume 
that the hypothesis is true, and the two variances cancel out in the above expression leaving 
52/52, which follows the same F distribution. The ratio 57/52 will be designated V.R. for 
variance ratio. 

For a two-sided test, we follow the convention of placing the larger sample variance 
in the numerator and obtaining the critical value of F for а /2 and the appropriate degrees of 
freedom. However, for a one-sided test, which of the two sample variances is to be placed in 
the numerator is predetermined by the statement of the null hypothesis. For example, for 
the null hypothesis that 01/05, the appropriate test statistic is V.R. = 51/55. The critical 
value of F is obtained for o (not w/2) and the appropriate degrees of freedom. In like 
manner, if the null hypothesis is that о? > о, the appropriate test statistic is У.К. = 82 / 52. 
In all cases, the decision rule is to reject ће null hypothesis if the computed У.К. is equal to 
or greater than the critical value of F. 


EXAMPLE 7.8.1 


Borden et al. (A-30) compared meniscal repair techniques using cadaveric knee specimens. 
One of the variables of interest was the load at failure (in newtons) for knees fixed with the 
FasT-FIX technique (group 1) and the vertical suture method (group 2). Each technique 
was applied to six specimens. The standard deviation for the FasT-FIX method was 30.62, 
and the standard deviation for the vertical suture method was 11.37. Can we conclude that, 
in general, the variance of load at failure is higher for the FasT-FIX technique than the 
vertical suture method? 


Solution: 


1. Data. See the statement of the example. 


2. Assumptions. Each sample constitutes a simple random sample of a 
population of similar subjects. The samples are independent. We assume 
the loads at failure in both populations are approximately normally 
distributed. 
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FIGURE 7.8.1 Rejection and nonrejection regions, 
Example 7.8.1. 


3. Hypotheses. 


4. Test statistic. 


Ув. = (7.8.1) 


5. Distribution of test statistic. When the null hypothesis is true, the test 
statistic is distributed as F with n, — 1 numerator and п» — 1 denomi- 
nator degrees of freedom. 

6. Decision rule. Let o = .05. The critical value of F, from Appendix 
Table G, is 5.05. Note that if Table G does not contain an entry for the 
given numerator degrees of freedom, we use the column closest in value 
to the given numerator degrees of freedom. Reject Но if V.R. > 5.05. 
The rejection and nonrejection regions are shown in Figure 7.8.1. 


7. Calculation of test statistic. 


62) 
yra С = ays 
(11.37) 
8. Statistical decision. We reject Ho, since 7.25 > 5.05; that is, the 
computed ratio falls in the rejection region. 


9. Conclusion. The failure load variability is higher when using the FasT- 
FIX method than the vertical suture method. 


10. p value. Because the computed V.R. of 7.25 is greater than 5.05, the p 
value for this test is less than 0.05. Excel calculates this p value to be 


‚0243. " 


Several computer programs can be used to test the equality of two variances. Outputs 
from these programs will differ depending on the test that is used. We saw in Figure 7.3.3, 
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for example, that the SAS system uses a folded F-test procedure. MINITAB uses two 
different tests. The first is an F-test under the assumption of normality, and the other is a 
modified Levene's test (1) that is used when normality cannot be assumed. SPSS uses an 
unmodified Levene's test (2). Regardless of the options, these tests are generally 
considered superior to the variance ratio test that is presented in Example 7.8.1. Discussion 
of the mathematics behind these tests is beyond the scope of this book, but an example is 
given to illustrate these procedures, since results from these tests are often provided 
automatically as outputs when a computer program is used to carry out a t-test. 


EXAMPLE 7.8.2 


Using the data from Example 7.3.2, we are interested in testing whether the assumption of 
the equality of variances can be assumed prior to performing a t-test. For ease of discussion, 
the data are reproduced below (Table 7.8.1): 


TABLE 7.8.1 Pressures (mm Hg) Under the Pelvis During Static Conditions for 
Example 7.3.2 


131 115 124 131 122 117 88 114 150 169 
60 150 130 180 163 130 121 119 130 148 


Control 
SCI 


Partial outputs for MINITAB, SAS, and SPSS are shown in Figure 7.8.2. Regardless of 
the test or program that is used, we fail to reject the null hypothesis of equal variances 
(Ho: о? = o2) because all p values > 0.05. We may now proceed with a t-test under the 
assumption of equal variances. I] 


MINITAB Output SPSS Output 


F-Test Levene's Test for 
Test Statistic 0.46 Equality of Variances 
P-Value 0.263 


F Sig. 


Levene's Test 


Test Statistic 0.49 
P-Value 0.495 


.482 


SAS Output 


Equality of Variances 


Variable Method Pr РЕ 
pressure Folded F 0.2626 


FIGURE 7.8.2 Partial MINITAB, SPSS, and SAS outputs for testing the equality of two 
population variances. 
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EXERCISES 


7.8.1 


7.8.2 


7.8.3 


7.8.4 


7.8.5 


7.8.6 


In the following exercises perform the ten-step test. For each exercise, as appropriate, explain why 
you chose a one-sided test or a two-sided test. Discuss how you think researchers or clinicians might 
use the results of your hypothesis test. What clinical or research decisions or actions do you think 
would be appropriate in light of the results of your test? 


Dora et al. (A-31) investigated spinal canal dimensions in 30 subjects symptomatic with disc 
herniation selected for a discectomy and 45 asymptomatic individuals. The researchers wanted to 
know if spinal canal dimensions are a significant risk factor for the development of sciatica. Toward 
that end, they measured the spinal canal dimension between vertebrae L3 and L4 and obtained a 
mean of 17.8 mm in the discectomy group with a standard deviation of 3.1. In the control group, the 
mean was 18.5 mm with a standard deviation of 2.8 mm. Is there sufficient evidence to indicate that in 
relevant populations the variance for subjects symptomatic with disc herniation is larger than the 
variance for control subjects? Let a = .05. 


Nagy et al. (A-32) studied 50 stable patients who were admitted for a gunshot wound that traversed 
the mediastinum. Of these, eight were deemed to have a mediastinal injury and 42 did not. The 
standard deviation for the ages of the eight subjects with mediastinal injury was 4.7 years, and the 
standard deviation of ages for the 42 without injury was 11.6 years. Can we conclude from these data 
that the variance of age is larger for a population of similar subjects without injury compared to a 
population with mediastinal injury? Let o — .05. 


A test designed to measure level of anxiety was administered to a sample of male and a sample of 
female patients just prior to undergoing the same surgical procedure. The sample sizes and the 
variances computed from the scores were as follows: 


Males: n= 16, 5? = 150 
Females п=21, 5 = 275 


Do these data provide sufficient evidence to indicate that in the represented populations the scores 
made by females are more variable than those made by males? Let o — .05. 


In an experiment to assess the effects on rats of exposure to cigarette smoke, 11 animals were 
exposed and 11 control animals were not exposed to smoke from unfiltered cigarettes. At the end 
of the experiment, measurements were made of the frequency of the ciliary beat (beats/min at 
20°С) in each animal. The variance for the exposed group was 3400 and 1200 for the unexposed 
group. Do these data indicate that in the populations represented the variances are different? 
Let a = .05. 


Two pain-relieving drugs were compared for effectiveness on the basis of length of time elapsing 
between administration of the drug and cessation of pain. Thirteen patients received drug 1, and 13 
received drug 2. The sample variances were 5 — 64 and $ = 16. Test the null hypothesis that the two 
populations variances are equal. Let o = .05. 


Packed cell volume determinations were made on two groups of children with cyanotic congenital 
heart disease. The sample sizes and variances were as follows: 


Group n s 


1 10 40 
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Do these data provide sufficient evidence to indicate that the variance of population 2 is larger than 
the variance of population 1? Let o = .05. 


7.8.7 Independent simple random samples from two strains of mice used in an experiment yielded the 
following measurements on plasma glucose levels following a traumatic experience: 
Strain A: 54,99, 105,46, 70, 87, 55, 58, 139, 91 
StrainB: 93,91, 93, 150, 80, 104, 128, 83, 88, 95, 94, 07 


Do these data provide sufficient evidence to indicate that the variance is larger in the population of 
strain A mice than in the population of strain B mice? Let œ = .05. What assumptions are necessary? 


7.9 THE TYPE Il ERROR AND 
THE POWER OF A TEST 


In our discussion of hypothesis testing our focus has been on o, the probability of 
committing a type I error (rejecting a true null hypothesis). We have paid scant attention 
to В, the probability of committing a type II error (failing to reject a false null hypothesis). 
There is a reason for this difference in emphasis. For a given test, o is a single number 
assigned by the investigator in advance of performing the test. It is a measure of the 
acceptable risk of rejecting a true null hypothesis. On the other hand, 8 may assume one of 
many values. Suppose we wish to test the null hypothesis that some population parameter is 
equal to some specified value. If Но is false and we fail to reject it, we commit a type II 
error. If the hypothesized value of the parameter is not the true value, the value of В (the 
probability of committing a type II error) depends on several factors: (1) the true value of 
the parameter of interest, (2) the hypothesized value of the parameter, (3) the value of o, 
and (4) the sample size, n. For fixed o and n, then, we may, before performing a hypothesis 
test, compute many values of В by postulating many values for the parameter of interest 
given that the hypothesized value is false. 

For a given hypothesis test it is of interest to know how well the test controls type II 
errors. If Но is in fact false, we would like to know the probability that we will reject it. The 
power of a test, designated 1 — В, provides this desired information. The quantity 1 — £ is 
the probability that we will reject a false null hypothesis; it may be computed for any 
alternative value of the parameter about which we are testing a hypothesis. Therefore, 
1 — Bis the probability that we will take the correct action when Но is false because the true 
parameter value is equal to the one for which we computed 1 — В. For a given test we may 
specify any number of possible values of the parameter of interest and for each compute the 
value of 1 — 8. The result is called a power function. The graph of a power function, called 
a power curve, is a helpful device for quickly assessing the nature of the power of a given 
test. The following example illustrates the procedures we use to analyze the power of a test. 


EXAMPLE 7.9.1 


Suppose we have a variable whose values yield a population standard deviation of 3.6. 
From the population we select a simple random sample of size n — 100. We select a value 
of о = .05 for the following hypotheses: 


Но: м = 17.5, НА: м я 17.5 


Solution: 
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When we study the power of a test, we locate the rejection and nonrejection 
regions on the x scale rather than the z scale. We find the critical values of x 
for a two-sided test using the following formulas: 


Tu = Ho + = (1.9.1) 


T 


and 


a с 
XL = Lo — Cm (7.9.2) 


where xy and х, are the upper and lower critical values, respectively, of x; 
+z and —z are the critical values of z; and шо is the hypothesized value of u. 
For our example, we have 
3.6 
ху = 17.50 + збо, = 17.50 + 1.96(.36) 


= 17.50 + .7056 = 18.21 


and 
хі, = 17.50 — 1.96(.36) = 17.50 — .7056 = 16.79 


Suppose that Ho is false, that is, that yu is not equal to 17.5. In that case, 
u is equal to some value other than 17.5. We do not know the actual value of 
ш. But if Но is false, jz is one of the many values that are greater than or 
smaller than 17.5. Suppose that the true population mean is ш = 16.5. Then 
the sampling distribution of x; is also approximately normal, with 
их = и = 16.5. We call this sampling distribution f(x1), and we call the 
sampling distribution under the null hypothesis f(x). 

P, the probability of the type II error of failing to reject a false null 
hypothesis, is the area under the curve of f(xi) that overlaps the non- 
rejection region specified under Но. To determine the value of В, we find the 
area under f (x1), above the x axis, and between x = 16.79 and x = 18.21. 
The value of Bis equal to P(16.79 < x < 18.21) when u = 16.5. This is the 
same as 


16.79 — 16.5 18.21 — 16.5 .29 1.71 
Р-р = Pl — <z< — 
( 36 ро 36 ) Е DX 5) 


= Р(.81 < z < 4.75) 
1 — .7910 = 2090 


й 


Thus, the probability of taking an appropriate action (that is, rejecting 
Но) when the null hypothesis states that u = 17.5, but in fact и = 16.5, is 
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= ds z Nonrejection 2. : 
Rejection region ———»-— region "| *—— Rejection region 


f Gg) 


мі 


+ —e—e e——e 


-—® 
16 16.5 16.79 17.5 18 [18.21 19 


FIGURE 7.9.1 Size of В for selected values for H4 for Example 7.9.1. 


1 — 2090 = .7910. As we noted, џи may be one of a large number of possible 
values when Но is false. Figure 7.9.1 shows a graph of several such 
possibilities. Table 7.9.1 shows the corresponding values of B and 1 — В 
(which are approximate), along with the values of В for some additional 
alternatives. 

Note that in Figure 7.9.1 and Table 7.9.1 those values of и under the 
alternative hypothesis that are closer to the value of u specified by Но have 
larger associated В values. For example, when u = 18 under the alternative 
hypothesis, В = .7190; and when u = 19.0 under Ha, В = .0143. The power 
of the test for these two alternatives, then, is 1 — .7190 = .2810 and 
1 — 0143 = .9857, respectively. We show the power of the test graphically 
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TABLE 7.9.1 Values of В and 1-8 for 
Selected Alternative Values of цу, 
Example 7.9.1 


Possible Values ої и Under 
На When Hj, is False p 1-8 


16.0 0.0143 0.9857 
16.5 0.2090 0.7910 
17.0 0.7190 0.2810 
18.0 0.7190 0.2810 
18.5 0.2090 0.7910 
19.0 0.0143 0.9857 


0 L і т | | | | 
16.0 17.0 18.0 19.0 


Alternative values ої u 


FIGURE 7.9.2 Ромуег curve for Example 7.9.1. 


in a power curve, as in Figure 7.9.2. Note that the higher the curve, the greater 
the power. m 


Although only one value of o is associated with a given hypothesis test, there are many 
values of В, one for each possible value of u if мо is not the true value of и as hypothesized. 
Unless alternative values of u are much larger or smaller than uy, В is relatively large 
compared with o. Typically, we use hypothesis-testing procedures more often in those 
cases in which, when Но is false, the true value of the parameter is fairly close to 
the hypothesized value. In most cases, В, the computed probability of failing to reject a 
false null hypothesis, is larger than о, the probability of rejecting a true null hypothesis. 
These facts are compatible with our statement that a decision based on a rejected null 
hypothesis is more conclusive than a decision based on a null hypothesis that is not 
rejected. The probability of being wrong in the latter case is generally larger than the 
probability of being wrong in the former case. 

Figure 7.9.2 shows the V-shaped appearance of a power curve for a two-sided test. In 
general, a two-sided test that discriminates well between the value of the parameter in Ho 
and values in Н, results in a narrow V-shaped power curve. A wide V-shaped curve 
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indicates that the test discriminates poorly over a relatively wide interval of alternative 
values of the parameter. 


Power Curves for One-Sided Tests The shape of a power curve for a one- 
sided test with the rejection region in the upper tail is an elongated S. If the rejection region 
of a one-sided test is located in the lower tail of the distribution, the power curve takes the 
form of a reverse elongated S. The following example shows the nature of the power curve 
for a one-sided test. 


EXAMPLE 7.9.2 


The mean time laboratory employees now take to do a certain task on a machine is 65 
seconds, with a standard deviation of 15 seconds. The times are approximately normally 
distributed. The manufacturers of a new machine claim that their machine will reduce the 
mean time required to perform the task. The quality-control supervisor designs a test to 
determine whether or not she should believe the claim of the makers of the new machine. 
She chooses a significance level of а = 0.01 and randomly selects 20 employees to 
perform the task on the new machine. The hypotheses are 


Но: u > 65, НА: и < 65 
The quality-control supervisor also wishes to construct a power curve for the test. 


Solution: The quality-control supervisor computes, for example, the following 
value of 1 — В for the alternative и = 55. The critical value of 1 — В 


for the test is 
15 
65 — 2.33| —— | = 57 
(va) 


We find f as follows: 


57 — 55 
15/4/20 


В PG» 51а = 55) = Р(с> 


1 — 7257 = .2743 


) = P(z > .60) 


Consequently, 1 — В = 1 - .2743 = .7257. Figure 7.9.3 shows the calcu- 
lation of f. Similar calculations for other alternative values of и 


А) 


55 57 65 
FIGURE 7.9.3 f calculated for u = 55. 
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1.00 = 
0.90 — 
0.80 — 
0.70 — 
0.60 [— 
0.50 — 
0.40 - 
0.30 |— 
0.20 |— 
0.10 — 


51 53 55 57 59 61 63 65 
Alternative values of u 


FIGURE 7.9.4 Power curve for Example 7.9.2. 


also yield values of 1 — 8. When plotted against the values of u, these give 
the power curve shown in Figure 7.9.4. и 


Operating Characteristic Curves Another way of evaluating a test is to 
look at its operating characteristic (OC) curve. To construct an OC curve, we plot values of 
В, rather than 1 — В, along the vertical axis. Thus, an OC curve is the complement of the 
corresponding power curve. 


EXERCISES 


Construct and graph the power function for each of the following situations. 
7.9.1 Но: и < 516, Нл: и > 516, п= 16, с «32, а = 0.05. 
7.9.2 Ho: и 3, НА: u = 3, п = 100, с= 1, а = 0.05. 
7.9.3 Ho: и < 4.25, НА: и > 4.25, п=81, д = 1.8, а = 0.01. 


7.10 DETERMINING SAMPLE SIZE 
TO CONTROL TYPE Il ERRORS 


You learned in Chapter 6 how to find the sample sizes needed to construct confidence 
intervals for population means and proportions for specified levels of confidence. You 
learned in Chapter 7 that confidence intervals may be used to test hypotheses. The method 
of determining sample size presented in Chapter 6 takes into account the probability of a 
type I error, but not a type II error since the level of confidence is determined by the 
confidence coefficient, 1 — o. 
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In many statistical inference procedures, the investigator wishes to consider the type 
II error as well as the type I error when determining the sample size. To illustrate the 
procedure, we refer again to Example 7.9.2. 


EXAMPLE 7.10.1 


In Example 7.9.2, the hypotheses are 


Но: u > 65, НА: и < 65 


The population standard deviation is 15, and the probability of a type I error is set at .01. 
Suppose that we want the probability of failing to reject Но(В) to be .05 if Но is false 
because the true mean is 55 rather than the hypothesized 65. How large a sample do we 
need in order to realize, simultaneously, the desired levels of о and В? 


Solution: 


Fora = .01 andn = 20, Bis equal to .2743. The critical value is 57. Under the 
new conditions, the critical value is unknown. Let us call this new critical value 
C. Let мо be the hypothesized mean and jz, the mean under the alternative 
hypothesis. We can transform each of the relevant sampling distributions of x, 
the one with a mean of ¡uy and the one with a mean of и, to a z distribution. 
Therefore, we can convert C to a z value on the horizontal scale of each of the 
two standard normal distributions. When we transform the sampling distribu- 
tion of x that has a mean of ¡uy to the standard normal distribution, we call the z 
that results го. When we transform the sampling distribution x that has a 
mean of ш to the standard normal distribution, we call the z that results 21. 
Figure 7.10.1 represents the situation described so far. 

We can express the critical value C as a function of zo and шо and also as 
a function of zı and ш. This gives the following equations: 


O 
G= — 10 —= 7.10.1 
Шо 2m ( ) 

O 
С=ш+а-= (1.10.2) 


vA 


My С Ho 
| | | 
1 1 t < 
0 a | 
І І 
І І z 
£p 0 


FIGURE 7.10.1 Graphic representation of relationships in determination 
of sample size to control both type І and type ll errors. 


EXERCISES 279 


We set the right-hand sides of these equations equal to each other and solve 
for n, to obtain 


2 
n= DEM (7.10.3) 
E 1 


To find n for our illustrative example, we substitute appropriate quanti- 
ties into Equation 7.10.3. We have шо = 65, шу = 55, and о = 15. From 
Appendix Table D, the value of z that has .01 of the area to its left is —2.33. The 
value of z that has .05 of the area to its right is 1.645. Both zo and z; are taken as 
positive. We determine whether C lies above or below either ш or u, when we 
substitute into Equations 7.10.1 and 7.10.2. Thus, we compute 


(2.33 + 1.645) (15)]? 


2 = 35.55 
" (65 — 55) 


We would need a sample of size 36 to achieve the desired levels of œ and В 
when we choose ш = 55 as the alternative value of и. 

We now compute C, the critical value for the test, and state an appropriate 
decision rule. To find C, we may substitute known numerical values into either 
Equation 7.10.1 or Equation 7.10.2. For illustrative purposes, we solve both 
equations for C. First we have 


15 
С 265—233| —= | = 59.175 
Е x) 


From Equation 7.10.2, we have 
15 
v 36 


The difference between the two results is due to rounding error. 
The decision rule, when we use the first value of C, is as follows: 


с=55-165( ) z 59.1125 


Select a sample of size 36 and compute x, if x < 59.175, reject Ho. If 
x > 59.175, do not reject Ho. 


We have limited our discussion of the type II error and the power of a 
test to the case involving a population mean. The concepts extend to cases 
involving other parameters. п 


EXERCISES 


7.10.1 


7.10.2 


7.10.3 


Given Но: и = 516, Ha: u > 516, n=16, с = 32, а = .05. Let В = .10 and ш = 520, and 
find n and C. State the appropriate decision rule. 

Given Но: и < 4.500, НА: u > 4.500, n= 16, 0 = .020, о = .01. Let 8 = .05 and u = 4.52, 
and find n and C. State the appropriate decision rule. 

Given Но: и < 4.25, Ha: p>4.25, п = 81, а = 1.8, а = .01. Let В = 03 and ш = 5.00, 
and find n and C. State the appropriate decision rule. 
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7.11 SUMMARY 


In this chapter the general concepts of hypothesis testing are discussed. A general 
procedure for carrying out a hypothesis test consisting of the following ten steps is 
suggested. 


"n 


Description of data. 

Statement of necessary assumptions. 

Statement of null and alternative hypotheses. 
Specification of the test statistic. 

Specification of the distribution of the test statistic. 
Statement of the decision rule. 

Calculation of test statistic from sample data. 


The statistical decision based on sample results. 


Nope cU gu UD Re шә 


Conclusion. 


LT 
Р 


Determination of p value. 


A number of specific hypothesis tests are described in detail and illustrated with 
appropriate examples. These include tests concerning population means, the difference 
between two population means, paired comparisons, population proportions, the difference 
between two population proportions, a population variance, and the ratio of two population 
variances. In addition we discuss the power of a test and the determination of sample size 
for controlling both type I and type II errors. 


SUMMARY OF FORMULAS FOR CHAPTER 7 


Formula Number Name Formula 
7.1.1, 7.1.2, 7.2.1 z-transformation = X — Uo 
(using either jz or шо) o/yn 
7.2.2 t-transformation "m X— Ho 
з/п 
7.2.3 Test statistic when p X— Ho 
sampling from a s/yn 


population that is not 
normally distributed 


7.3.1 Test statistic when — (я — %2) — (ш — Modo 
sampling from normally є 2 2 
КЕ NE Ot 05 
distributed populations: — + 


population variances 
known 
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7.3.2 


Test statistic when 
sampling from normally 
distributed populations: 
population variances 
unknown and equal 


t= Qi — x) — (ш = 2 where 


7.3.3, 7.3.4 


Test statistic when 
sampling from normally 
distributed populations: 
population variances 
unknown and unequal 


7.3.5 


Sampling from 
populations that are not 
normally distributed 


7.4.1 


Test statistic for paired 
differences when the 
population variance is 
unknown 


7.4.2 


Test statistic for paired 
differences when the 
population variance is 
known 


7.5.1 


Test statistic for a single 
population proportion 


7.6.1, 7.6.2 


Test statistic for the 
difference between two 
population proportions 


7.7.1 


Test statistic for a single 
population variance 


7.8.1 


Variance ratio 


(Continued) 
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7.9.1, 7.9.2 Upper and lower critical Iu = Mo ша 
values for x vn 
т с 
XL = Ho — UA 
7.10.1, 7.10.2 Critical value for C o: g 
=p zZ0—-—H 21 
determining sample 0 yn ж уп 
size to control 
type П errors 
7.10.3 Sample size to control (zo + zi)o 2 
type II errors n= je Z E 
Symbol Key * a = type 1 error rate 


* C — critical value 

* X? — chi-square distribution 

* d — average difference 

e u = mean of population 

* мо = hypothesized mean 

* n — sample size 

* p — proportion for population 

* p — average proportion 
*а=(1—р) 

* p = estimated proportion for sample 
* o? — population variance 

* о = population standard deviation 

* og = standard error of difference 

* 0, — standard error 

5 = standard deviation of sample 

* 5; — standard deviation of the difference 
* 5, — pooled standard deviation 

• t = Student's t-transformation 

• ¢ = Cochran's correction to t 

x — mean of sample 

XL — lower limit of critical value for x 
Xu — upper limit of critical value for x 
z — standard normal transformation 


REVIEW QUESTIONS AND EXERCISES 


1. Whatis the purpose of hypothesis testing? 


2. What is a hypothesis? 


3. List and explain each step in the ten-step hypothesis testing procedure. 
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Define: 
(a) Type I error (b) Type II error 
(c) The power of a test (d) Power function 


(e) Power curve (f) Operating characteristic curve 


Explain the difference between the power curves for one-sided tests and two-sided tests. 


Explain how one decides what statement goes into the null hypothesis and what statement goes into 
the alternative hypothesis. 


What are the assumptions underlying the use of the r statistic in testing hypotheses about a single 
mean? The difference between two means? 


When may the z statistic be used in testing hypotheses about 
(a) a single population mean? 

(b) the difference between two population means? 

(c) a single population proportion? 


(d) the difference between two population proportions? 


In testing a hypothesis about the difference between two population means, what is the rationale 
behind pooling the sample variances? 


Explain the rationale behind the use of the paired comparisons test. 


Give an example from your field of interest where a paired comparisons test would be appropriate. 
Use real or realistic data and perform an appropriate hypothesis test. 


Give an example from your field of interest where it would be appropriate to test a hypothesis about 
the difference between two population means. Use real or realistic data and carry out the ten-step 
hypothesis testing procedure. 


Do Exercise 12 for a single population mean. 

Do Exercise 12 for a single population proportion. 

Do Exercise 12 for the difference between two population proportions. 
Do Exercise 12 for a population variance. 


Do Exercise 12 for the ratio of two population variances. 


Ochsenkühn et al. (A-33) studied birth as a result of in vitro fertilization (IVF) and birth from 
spontaneous conception. In the sample, there were 163 singleton births resulting from IVF with 
a mean birth weight ої 3071g and sample standard deviation of 761g. Among the 321 
singleton births resulting from spontaneous conception, the mean birth weight was 3172 g with 
a standard deviation of 702g. Determine if these data provide sufficient evidence for us to 
conclude that the mean birth weight in grams of singleton births resulting from IVF is lower, in 
general, than the mean birth weight of singleton births resulting from spontaneous conception. 
Let o — .10. 


William Tindall (A-34) performed a retrospective study of the records of patients receiving care for 
hypercholesterolemia. The following table gives measurements of total cholesterol for patients 
before and 6 weeks after taking a statin drug. Is there sufficient evidence at the a = .01 level of 
significance for us to conclude that the drug would result in reduction in total cholesterol in a 
population of similar hypercholesterolemia patients? 
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Id. No. Before After Id. No. Before After Id. No. Before After 
1 195 125 37 221 191 73 205 151 
2 208 164 38 245 164 74 298 163 
3 254 152 39 250 162 75 305 171 
4 226 144 40 266 180 76 262 129 
5 290 212 41 240 161 77 320 191 
6 239 171 42. 218 168 78 271 167 
7 216 164 43 278 200 79 195 158 
8 286 200 44 185 139 80 345 192 
9 243 190 45 280 207 81 223 117 

10 217 130 46 278 200 82 220 114 

11 245 170 47 223 134 83 279 181 

12 257 182 48 205 133 84 252 167 

13 199 153 49 285 161 85 246 158 

14 277 204 50 314 203 86 304 190 

15 249 174 51 235 152 87 292 177 

16 197 160 52 248 198 88 276 148 

17 279 205 53 291 193 89 250 169 

18 226 159 54 231 158 90 236 185 

19 262 170 55 208 148 91 256 172 

20 231 180 56 263 203 92 269 188 

21 234 161 57 205 156 93 235 172 

22 170 139 58 230 161 94 184 151 

23 242 159 59 250 150 95 253 156 

24 186 114 60 209 181 96 352 219 

25 223 134 61 269 186 97 266 186 

26 220 166 62 261 164 98 321 206 

27 277 170 63 255 164 99 233 173 

28 235 136 64 275 195 100 224 109 

29 216 134 65 239 169 101 274 109 

30 197 138 66 298 177 102 222 136 

31 253 181 67 265 217 103 194 131 

32 209 147 68 220 191 104 293 228 

33 245 164 69 196 129 105 262 211 

34 217 159 70 177 142 106 306 192 

35 187 139 71 211 138 107 239 174 

36 265 171 72 244 166 


Source: Data provided courtesy of William Tindall, Ph.D. and the Wright State University 
Consulting Center. 


The objective of a study by van Vollenhoven et al. (A-35) was to examine the effectiveness of 
Etanercept alone and Etanercept in combination with methotrexate in the treatment of rheumatoid 
arthritis. They performed a retrospective study using data from the STURE database, which 
collects efficacy and safety data for all patients starting biological treatments at the major 
hospitals in Stockholm, Sweden. The researchers identified 40 subjects who were prescribed 
Etanercept only and 57 who were given Etanercept with methotrexate. One of the outcome 
measures was the number of swollen joints. The following table gives the mean number of swollen 
joints in the two groups as well as the standard error of the mean. Is there sufficient evidence at the 
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о = .05 level of significance for us to conclude that there is a difference in mean swollen joint 
counts in the relevant populations? 


Treatment Mean Standard Error of Mean 
Etanercept 5.56 0.84 
Etanercept plus methotrexate 4.40 0.57 


Miyazaki et al. (A-36) examined the recurrence-free rates of stripping with varicectomy and stripping 
with sclerotherapy for the treatment of primary varicose veins. The varicectomy group consisted of 
122 limbs for which the procedure was done, and the sclerotherapy group consisted of 98 limbs for 
which that procedure was done. After 3 years, 115 limbs of the varicectomy group and 87 limbs of the 
sclerotherapy group were recurrence-free. Is this sufficient evidence for us to conclude there is no 
difference, in general, in the recurrence-free rate between the two procedures for treating varicose 
veins? Let o — .05. 


Recall the study, reported in Exercise 7.8.1, in which Dora et al. (A-37) investigated spinal 
canal dimensions in 30 subjects symptomatic with disc herniation selected for a discectomy 
and 45 asymptomatic individuals (control group). One of the areas of interest was determining 
if there is a difference between the two groups in the spinal canal cross-sectional area (cm?) 
between vertebrae L5/S1. The data in the following table are simulated to be consistent with 
the results reported in the paper. Do these simulated data provide evidence for us to conclude 
that a difference in the spinal canal cross-sectional area exists between a population of 
subjects with disc herniations and a population of those who do not have disc herniations? Let 
а = .05. 


Herniated Disc Group Control Group 


2.00 2.57 1.98 321 3.59 3.72 4.30 2.87 3.87 2.73 5.28 
1.60 1.80 3.91 2.56 1.53 1.33 2.36 3.67 1.64 3.54 3.63 
2.39 2.67 3.53 226 2.82 4.26 3.08 3.32 4.00 2.76 3.58 
2.05 1.19 3.01 2.39 3.61 3.11 3.94 439 3.73 222 2.73 
2.09 3.79 2.45 2.55 2.10 5.02 3.62 3.02 3.15 3.57 2.37 
2.28 2.33 2.81 3.70 2.61 5.42 335 2.62 3.72 437 528 
4.97 2.58 2.25 3.12 3.43 

3.95 2.98 4.11 3.08 222 


Source: Simulated data. 


Iannelo et al. (A-38) investigated differences between triglyceride levels in healthy obese (control) 
subjects and obese subjects with chronic active B or C hepatitis. Triglyceride levels of 208 obese 
controls had a mean value of 1.81 with a standard error of the mean of .07 mmol/L. The 19 obese 
hepatitis subjects had a mean of .71 with a standard error of the mean of .05. Is this sufficient evidence 
for us to conclude that, in general, a difference exists in average triglyceride levels between obese 
healthy subjects and obese subjects with hepatitis B or C? Let o = .01. 


Kindergarten students were the participants in a study conducted by Susan Bazyk et al. (A-39). The 
researchers studied the fine motor skills of 37 children receiving occupational therapy. They used an 
index of fine motor skills that measured hand use, eye-hand coordination, and manual dexterity 
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before and after 7 months of occupational therapy. Higher values indicate stronger fine motor skills. 
The scores appear in the following table. 


Subject | Pre Post Subject | Pre Post 


1 91 94 20 76 112 
2 61 94 21 79 91 
3 85 103 22 97 100 
4 88 112 23 109 112 
5 94 91 24 70 70 
6 112 112 25 58 76 
7 109 112 26 97 97 
8 79 97 21 112 112 
9 109 100 28 97 112 
10 115 106 29 112 106 
11 46 46 30 85 112 
12 45 41 31 112 112 
13 106 112 32 103 106 
14 112 112 33 100 100 
15 91 94 34 88 88 
16 115 112 35 109 112 
17 59 94 36 85 112 
18 85 109 37 88 97 
19 112 112 


Source: Data provided courtesy of Susan Bazyk, M.H.S. 


Can one conclude on the basis of these data that after 7 months, the fine motor skills in a population of 
similar subjects would be stronger? Let o = .05. Determine the p value. 


A survey of 90 recently delivered women on the rolls of a county welfare department revealed that 
27 had a history of intrapartum or postpartum infection. Test the null hypothesis that the population 
proportion with a history of intrapartum or postpartum infection is less than or equal to .25. Let 
о = .05. Determine the p value. 


In a sample of 150 hospital emergency admissions with a certain diagnosis, 128 listed vomiting as a 
presenting symptom. Do these data provide sufficient evidence to indicate, at the .01 level of 
significance, that the population proportion is less than .92? Determine the p value. 


A research team measured tidal volume in 15 experimental animals. The mean and standard deviation 
were 45 and 5cc, respectively. Do these data provide sufficient evidence to indicate that the 
population mean is greater than 40 cc? Let o — .05. 


A sample of eight patients admitted to a hospital with a diagnosis of biliary cirrhosis had a mean IgM 
level of 160.55 units per milliliter. The sample standard deviation was 50. Do these data provide 
sufficient evidence to indicate that the population mean is greater than 150? Let a = .05. Determine 
the p value. 


Some researchers have observed a greater airway resistance in smokers than in nonsmokers. Suppose 
a study, conducted to compare the percent of tracheobronchial retention of particles in smoking- 
discordant monozygotic twins, yielded the following results: 
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Percent Retention Percent Retention 


Smoking Twin Nonsmoking Twin Smoking Twin Nonsmoking Twin 


60.6 47.5 51.2 54.3 
12.0 13.3 62.7 13.9 
56.0 33.0 28.7 8.9 
75.2 552 66.0 46.1 
12.5 21.9 25.2 29.8 
29.7 27.9 40.1 362 


Do these data support the hypothesis that tracheobronchial clearance is slower in smokers? Let 
a = .05. Determine the p value for this test. 


Circulating levels of estrone were measured in a sample of 25 postmenopausal women following 
estrogen treatment. The sample mean and standard deviation were 73 and 16, respectively. At the .05 
significance level can one conclude on the basis of these data that the population mean is higher than 
70? 


Systemic vascular resistance determinations were made on a sample of 16 patients with chronic, 
congestive heart failure while receiving a particular treatment. The sample mean and standard 
deviation were 1600 and 700, respectively. At the .05 level of significance do these data provide 
sufficient evidence to indicate that the population mean is less than 2000? 


The mean length at birth of 14 male infants was 53 cm with a standard deviation of 9 cm. Can one 
conclude on the basis of these data that the population mean is not 50 ст? Let the probability of 
committing a type I error be .10. 


For each of the studies described in Exercises 33 through 38, answer as many of the following 
questions as possible: (a) What is the variable of interest? (b) Is the parameter of interest a mean, the 
difference between two means (independent samples), a mean difference (paired data), a proportion, 
or the difference between two proportions (independent samples)? (c) What is the sampled 
population? (d) What is the target population? (e) What are the null and alternative hypotheses? 
(f) Is the alternative one-sided (left tail), one-sided (right tail), or two-sided? (g) What type I and type II 
errors are possible? (h) Do you think the null hypothesis was rejected? Explain why or why not. 


During a one-year period, Hong et al. (A-40) studied all patients who presented to the surgical 
service with possible appendicitis. One hundred eighty-two patients with possible appendicitis 
were randomized to either clinical assessment (CA) alone or clinical evaluation and abdominal/ 
pelvic CT. A true-positive case resulted in a laparotomy that revealed a lesion requiring operation. 
A true-negative case did not require an operation at one-week follow-up evaluation. At the close of 
the study, they found no significant difference in the hospital length of stay for the two treatment 
groups. 


Recall the study reported in Exercise 7.8.2 in which Nagy et al. (A-32) studied 50 stable patients 
admitted for a gunshot wound that traversed the mediastinum. They found that eight of the subjects 
had a mediastinal injury, while 42 did not have such an injury. They performed а student's г test to 
determine if there was a difference in mean age (years) between the two groups. The reported p value 
was .59. 


Dykstra et al. (A-41) studied 15 female patients with urinary frequency with or without 
incontinence. The women were treated with botulinum toxin type B (BTX-B). A t test of the 
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pre/post-difference in frequency indicated that these 15 patients experienced an average of 5.27 
fewer frequency episodes per day after treatment with BTX-B. The p value for the test was less 
than 0.001. 


Recall the study reported in Exercise 6.10.2 in which Horesh et al. (A-42) investigated suicidal 
behavior among adolescents. In addition to impulsivity, the researchers studied hopelessness among 
the 33 subjects in the suicidal group and the 32 subjects in the nonsuicidal group. The means for the 
two groups on the Beck Hopelessness Scale were 11.6 and 5.2, respectively, and the г value for the test 
was 5.13. 


Mauksch et al. (A-43) surveyed 500 consecutive patients (ages 18 to 64 years) in a primary care clinic 
serving only uninsured, low-income patients. They used self-report questions about why patients 
were coming to the clinic, and other tools to classify subjects as either having or not having major 
mental illness. Compared with patients without current major mental illness, patients with a current 
major mental illness reported significantly (p < .001) more concerns, chronic illnesses, stressors, 
forms of maltreatment, and physical symptoms. 


A study by Hosking et al. (A-44) was designed to compare the effects of alendronate and risedronate 
on bone mineral density (BMD). One of the outcome measures was the percent increase in BMD at 
12 months. Alendronate produced a significantly higher percent change (4.8 percent) in BMD than 
risedronate (2.8 percent) with a p value < .001. 


For each of the following situations, identify the type I and type II errors and the correct actions. 
(a) Ho: A new treatment is not more effective than the traditional one. 


(1) Adopt the new treatment when the new one is more effective. 
(2) Continue with the traditional treatment when the new one is more effective. 
(3) Continue with the traditional treatment when the new one is not more effective. 
(4) Adopt the new treatment when the new one is not more effective. 
(b) Ho: A new physical therapy procedure is satisfactory. 


(1) Employ a new procedure when it is unsatisfactory. 
(2) Do not employ a new procedure when it is unsatisfactory. 
(3) Do not employ a new procedure when it is satisfactory. 
(4) Employ a new procedure when it is satisfactory. 

(c) Ho: A production run of a drug is of satisfactory quality. 


(1) Reject a run of satisfactory quality. 
(2) Accept a run of satisfactory quality. 
(3) Reject a run of unsatisfactory quality. 
(4) Accept a run of unsatisfactory quality. 


For each of the studies described in Exercises 40 through 55, do the following: 

(a) Perform a statistical analysis of the data (including hypothesis testing and confidence interval 
construction) that you think would yield useful information for the researchers. 

(b) State all assumptions that are necessary to validate your analysis. 

(c) Find p values for all computed test statistics. 


(d) Describe the population(s) about which you think inferences based on your analysis would be 
applicable. 


A study by Bell (A-45) investigated the hypothesis that alteration of the vitamin D-endocrine system 
in blacks results from reduction in serum 25-hydroxyvitamin D and that the alteration is reversed by 
oral treatment with 25-hydroxyvitamin Оз. The eight subjects (three men and five women) were 
studied while on no treatment (control) and after having been given 25-hydroxyvitamin D; for 7 days 
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(25-OHD3). The following are the urinary calcium (mg/d) determinations for the eight subjects under 
the two conditions. 


Subject Control 25-OHD; 


A 66 98 
B 115 142 
C 54 78 
D 88 101 
E 82 134 
F 115 158 
G 176 219 
H 46 60 Source: Data provided courtesy of 


Dr. Norman H. Bell. 


Montner et al. (A-46) conducted studies to test the effects of glycerol-enhanced hyperhydration 
(GEH) on endurance in cycling performance. The 11 subjects, ages 22-40 years, regularly cycled at 
least 75 miles per week. The following are the pre-exercise urine output volumes (ml) following 
ingestion of glycerol and water: 


Experimental, ml Control, ml 

Subject + (Glycerol) (Placebo) 

1 1410 2375 

2 610 1610 

3 1170 1608 

4 1140 1490 

5 515 1475 

6 580 1445 

7 430 885 

8 1140 1187 

9 720 1445 
10 275 890 
11 875 1785 Source: Data provided courtesy 


of Dr. Paul Montner. 


D'Alessandro et al. (A-47) wished to know if preexisting airway hyperresponsiveness (HR) 
predisposes subjects to a more severe outcome following exposure to chlorine. Subjects were 
healthy volunteers between the ages of 18 and 50 years who were classified as with and without HR. 
The following are the FEV, and specific airway resistance (Sraw) measurements taken on the 
subjects before and after exposure to appropriately diluted chlorine gas: 


Hyperreactive Subjects 


Pre-Exposure Post-Exposure 
Subject FEV; Sraw FEV, Sraw 


1 3.0 5.80 1.8 21.4 
2 4.1 9.56 3.7 12.5 
3 3.4 7.84 3.0 14.3 
4 3.3 6.41 3.0 10.9 
5 3.3 9.12 3.0 17.1 
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Normal Subjects 


Pre-Exposure Post-Exposure 
Subject FEV, Sraw FEV, Sraw 


1 4.3 5.52 4.2 8.70 
2 3.9 6.43 3.7 6.94 
3 3.6 5.67 3.3 10.00 
4 3.6 3.17 3.5 4.54 
5 51 5.53 4.9 7.37 Source: Data provided courtesy 


of Dr. Paul Blanc. 


Noting the paucity ofinformation on the effect of estrogen on platelet membrane fatty acid composition, 
Ranganath et al. (A-48) conducted a study to examine the possibility that changes may be present in 
postmenopausal women and that these may be reversible with estrogen treatment. The 31 women 
recruited for the study had not menstruated for at least 3 months or had symptoms of the menopause. No 
woman was on any form of hormone replacement therapy (HRT) at the time she was recruited. The 
following are the platelet membrane linoleic acid values before and after a period of HRT: 


Subject Before After Subject Before After Subject Before After 


1 6.06 5.34 12 7.65 5.55 23 5.04 4.74 
2 6.68 6.11 13 4.57 4.25 24 7.89 7.48 
3 5.22 5.79 14 5.97 5.66 25 7.98 6.24 
4 5.79 5.97 15 6.07 5.66 26 6.35 5.66 
5 6.26 5.93 16 6.32 5.97 21 4.85 4.26 
6 6.41 6.73 17 6.12 6.52 28 6.94 5.15 
7 4.23 4.39 18 6.05 5.70 29 6.54 5.30 
8 4.61 4.20 19 6.31 3.58 30 4.83 5.58 
9 6.79 5.97 20 4.44 4.52 31 4.71 4.10 

10 6.16 6.00 21 5.51 4.93 

11 6.41 5.35 22 8.48 8.80 


Source: Data provided courtesy of Dr. L. Ranganath. 


The purpose of a study by Goran et al. (A-49) was to examine the accuracy of some widely used body- 
composition techniques for children through the use of the dual-energy X-ray absorptiometry (DXA) 
technique. Subjects were children between the ages of 4 and 10 years. The following are fat mass 
measurements taken on the children by three techniques—DXA, skinfold thickness (ST), and 
bioelectrical resistance (BR): 


Sex 
DXA ST BR (1 = Male, 0 = Female) 
3.6483 4.5525 4.2636 1 
2.9174 2.8234 6.0888 0 
7.5302 3.8888 5.1175 0 
6.2417 5.4915 8.0412 0 
10.5891 10.4554 14.1576 0 
9.5756 11.1779 12.4004 0 
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Sex 

DXA ST BR (1 = Male, 0 = Female) 
2.4424 3.5168 3.7389 
3.5639 5.8266 4.3359 
1.2270 2.2467 2.7144 
2.2632 2.4499 2.4912 
2.4607 3.1578 1.2400 
4.0867 5.52772 6.8943 
4.1850 4.0018 3.0936 
2.7139 5.1745 Е 
4.4748 3.6897 4.2761 
4.2329 4.6807 5.2242 
2.9496 4.4187 4.9795 
2.9027 3.8341 4.9630 
5.4831 4.8781 5.4468 
3.6152 4.1334 4.1018 
5.3343 3.6211 4.3097 
3.2341 2.0924 2.5711 
5.4779 5.3890 5.8418 
4.6087 4.1792 3.9818 
2.8191 2.1216 1.5406 
4.1659 4.5373 5.1724 
3.7384 2.5182 4.6520 
4.8984 4.8076 6.5432 
3.9136 3.0082 3.2363 


12.1196 13.9266 16.3243 
15.4519 15.9078 18.0300 
20.0434 19.5560 21.7365 


оо ооо  -. RR нн НО ныне НН НН -O OO >»OOOOoO НОН Не 


9.5300 8.5864 4.1322 
2.7244 2.8653 2.7251 
3.8981 5.1352 5.2420 
4.9271 8.0535 6.0338 
3.5753 4.6209 5.6038 
6.7783 6.5755 6.6942 
3.2663 4.0034 3.2876 
1.5457 2.4742 3.6931 
2.1423 2.1845 2.4433 
4.1894 3.0594 3.0203 
1.9863 2.5045 3.2229 
3.3916 3.1226 3.3839 
2.3143 2.7677 3.7693 
1.9062 3.1355 12.4938 
3.7744 4.0693 5.9229 
2.3502 2.7872 4.3192 
4.6797 4.4804 6.2469 
4.7260 5.4851 7.2809 
4.2749 4.4954 6.6952 
2.6462 3.2102 3.8791 
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Sex 
DXA ST BR (1 = Male, 0 = Female) 
2.7043 3.0178 5.6841 0 
4.6148 4.0118 5.1399 0 
3.0896 3.2852 4.4280 0 
5.0533 5.6011 4.3556 0 
6.8461 7.4328 8.6565 1 
11.0554 13.0693 11.7701 1 
4.4630 4.0056 7.0398 0 
2.4846 3.5805 3.6149 0 
7.4703 5.5016 9.5402 0 
8.5020 6.3584 9.6492 0 
6.6542 6.8948 9.3396 1 
4.3528 4.1296 6.9323 0 
3.6312 3.8990 4.2405 1 
4.5863 5.1113 4.0359 1 
2.2948 2.6349 3.8080 1 
3.6204 3.7307 4.1255 1 
2.3042 3.5027 3,4347 1 
4.3425 3.7523 4.3001 1 
4.0726 3.0877 5.2256 0 
1.7928 2.8417 3.8734 1 
4.1428 3.6814 2.9502 1 
5.5146 5.2222 6.0072 0 
3.2124 2.7632 3.4809 1 
5.1687 5.0174 3.7219 1 
3.9615 4.5117 2.7698 1 
3.6698 4.9751 1.8274 1 
4.3493 7.3525 4.8862 0 
2.9417 3.6390 3.4951 1 
5.0380 4.9351 5.6038 0 
7.9095 9.5907 8.5024 0 
1.7822 3.0487 3.0028 1 
3.4623 3.3281 2.8628 1 
11.4204 14.9164 10.7378 1 
1.2216 2.2942 2.6263 1 
2.9375 3.3124 3.3728 1 
4.6931 5.4706 5.1432 0 
8.1227 7.7552 7.7401 0 
10.0142 8.9838 11.2360 0 
2.5598 2.8520 4.5943 0 
3.7669 3.7342 4.7384 0 
4.2059 2.6356 4.0405 0 
6.7340 6.6878 8.1053 0 
3.5071 3.4947 4.4126 1 
2.2483 2.8100 3.6705 0 ТЕ 
7.1891 5.4414 6.6332 0 ера CE 7 
6.4390 3.9532 5.1693 0 ource: Data provided courtesy о 


Dr. Michael I. Goran. 
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Hartard et al. (A-50) conducted a study to determine whether a certain training regimen can 
counteract bone density loss in women with postmenopausal osteopenia. The following are strength 
measurements for five muscle groups taken on 15 subjects before (B) and after (A) 6 months of 
training: 


Leg Press Hip Flexor Hip Extensor 
Subject (B) (A) (B) (A) (B) (A) 
1 100 180 8 15 10 20 
2 155 195 10 20 12 25 
3 115 150 8 13 12 19 
4 130 170 10 14 12 20 
5 120 150 7 12 12 15 
6 60 140 5 12 8 16 
7 60 100 4 6 6 9 
8 140 215 12 18 14 24 
9 110 150 10 13 12 19 
10 95 120 6 8 8 14 
11 110 130 10 12 10 14 
12 150 220 10 13 15 29 
13 120 140 9 20 14 25 
14 100 150 9 10 15 29 
15 110 130 6 9 8 12 
Arm Abductor Arm Adductor 
Subject (B) (A) (B) (A) 
1 10 12 12 19 
2 7 20 10 20 
3 8 14 8 14 
4 8 15 6 16 
5 8 13 9 13 
6 5 13 6 13 
7 4 8 4 8 
8 12 15 14 19 
9 10 14 8 14 
10 6 9 6 10 
11 8 11 8 12 
12 8 14 13 15 
13 8 19 11 18 
14 4 7 10 22 
15 4 8 8 12 


Source: Data provided courtesy of Dr. Manfred Hartard. 


Vitacca et al. (A-51) conducted a study to determine whether the supine position or sitting position 
worsens static, forced expiratory flows and measurements of lung mechanics. Subjects were aged 
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persons living in a nursing home who were clinically stable and without clinical evidence of 
cardiorespiratory diseases. Among the data collected were the following FEV, percent values for 
subjects in sitting and supine postures: 


Sitting Supine Sitting Supine 


64 56 103 94 
44 37 109 92 
44 39 —99 —99 
40 43 169 165 
32 32 73 66 
70 61 95 94 
82 58 —99 —99 
74 48 73 58 
91 63 


Source: Data provided courtesy of Dr. M. Vitacca. 


The purpose of an investigation by Young et al. (A-52) was to examine the efficacy and safety of a 
particular suburethral sling. Subjects were women experiencing stress incontinence who also met 
other criteria. Among the data collected were the following pre- and postoperative cystometric 
capacity (ml) values: 


Pre Post Pre Post Pre Post Pre Post 


350 3321 340 320 595 557 475 344 
700 483 310 336 315 221 427 277 
356 336 361 333 363 291 405 514 
362 447 339 280 305 310 312 402 
361 214 527 492 200 220 385 282 
304 285 245 330 270 315 274 317 
675 480 313 310 300 230 340 323 
367 330 241 230 792 575 524 383 
387 325 313 298 275 140 301 219 
535 325 323 349 307 192 411 383 
328 250 438 345 312 217 250 285 
557 410 497 300 375 462 600 618 
569 603 302 335 440 414 393 355 
260 178 471 630 300 250 232 252 
320 362 540 40 379 335 332 331 
405 235 275 278 682 339 451 400 
351 310 557 381 


Source: Data provided courtesy of Dr. Stephen B. Young. 


Diamond et al. (A-53) wished to know if cognitive screening should be used to help select appropriate 
candidates for comprehensive inpatient rehabilitation. They studied a sample of geriatric rehabilita- 
tion patients using standardized measurement strategies. Among the data collected were the 
following admission and discharge scores made by the subjects on the Mini Mental State 
Examination (MMSE): 


REVIEW QUESTIONS AND EXERCISES 295 


Admission Discharge | Admission Discharge 


9 10 24 26 
11 11 24 30 
14 19 24 28 
15 15 25 26 
16 17 25 22 
16 15 26 26 
16 17 26 28 
16 17 26 26 
17 14 27 28 
17 18 27 28 
17 21 27 27 
18 21 27 27 
18 21 27 27 
19 21 28 28 
19 25 28 29 
19 21 28 29 
19 22 28 29 
19 19 29 28 
20 22 29 28 
21 23 29 30 
22 22 29 30 
22 19 29 30 
22 26 29 30 
23 21 29 30 
24 21 30 30 
24 20 


Source: Data provided courtesy of Dr. Stephen N. Macciocchi. 


In a study to explore the possibility of hormonal alteration in asthma, Weinstein et al. (A-54) 
collected data on 22 postmenopausal women with asthma and 22 age-matched, postmenopausal, 
women without asthma. The following are the dehydroepiandrosterone sulfate (DHEAS) values 
collected by the investigators: 


Without Asthma With Asthma Without Asthma With Asthma 


20.59 87.50 15.90 166.02 
37.81 111.52 49.77 129.01 
76.95 143.75 25.86 31.02 
77.54 25.16 55.27 47.66 
19.30 68.16 33.83 171.88 
35.00 136.13 56.45 241.88 
146.09 89.26 19.91 235.16 
166.02 96.88 24.92 25.16 
96.58 144.34 76.37 78.71 
24.57 97.46 6.64 111.52 
53.52 82.81 115.04 54.69 


Source: Data provided courtesy of Dr. Robert E. Weinstein. 


296 


CHAPTER7 HYPOTHESIS TESTING 


50. 


51. 


The motivation for a study by Gruber et al. (A-55) was a desire to find a potentially useful serum 
marker in rheumatoid arthritis (RA) that reflects underlying pathogenic mechanisms. They meas- 
ured, among other variables, the circulating levels of gelatinase B in the serum and synovial fluid 
(SE) of patients with RA and of control subjects. The results were as follows: 


Serum Synovial Fluid Serum Synovial Fluid 


RA Control RA Control RA Control RA Control 


26.8 23.4 71.8 3.0 36.7 
19.1 30.5 29.4 4.0 57.2 
249.6 10.3 185.0 3.9 71.3 
53.6 8.0 114.0 6.9 25.2 
66.1 7.3 69.6 9.6 46.7 
52.6 10.1 52.3 22.1 30.9 


14.5 17.3 113.1 13.4 21.5 
22.7 24.4 104.7 13.3 17.2 


43.5 19.7 60.7 10.3 
25.4 8.4 116.8 7.5 
29.8 20.4 84.9 31.6 
27.6 16.3 215.4 30.0 
106.1 16.5 33.6 42.0 
76.5 22.2 158.3 20.3 


Source: Data provided courtesy of Dr. Darius Sorbi. 

Benini et al. (A-56) conducted a study to evaluate the severity of esophageal acidification in achalasia 
following successful dilatation of the cardias and to determine which factors are associated with 
pathological esophageal acidification in such patients. Twenty-two subjects, of whom seven were 
males; ranged in ages from 28 to 78 years. On the basis of established criteria they were classified 
asrefluxers or nonrefluxers. The following are the acid clearance values (min/reflux) for the 22 subjects: 


Refluxers Nonrefluxers 


8.9 2.3 
30.0 0.2 
23.0 0.9 

6.2 8.3 
11.5 0.0 

0.9 
0.4 
2.0 
0.7 
3.6 
0.5 
1.4 
0.2 
0.7 
17.9 
2.1 
0.0 


Source: Data provided courtesy 
of Dr. Luigi Benini. 


52. 


53. 
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The objective of a study by Baker et al. (A-57) was to determine whether medical deformation alters 
in vitro effects of plasma from patients with preeclampsia on endothelial cell function to produce a 
paradigm similar to the in vivo disease state. Subjects were 24 nulliparous pregnant women before 
delivery, of whom 12 had preeclampsia and 12 were normal pregnant patients. Among the data 
collected were the following gestational ages (weeks) at delivery: 


Preeclampsia Normal Pregnant 
38 40 

32 41 

42 38 

30 40 

38 40 

35 39 

32 39 

38 41 

39 41 

29 40 

d. d Source: Data provided courtesy 


of Dr. James M. Roberts. 


Zisselman et al. (A-58) conducted a study to assess benzodiazepine use and the treatment of 
depression before admission to an inpatient geriatric psychiatry unit in a sample of elderly patients. 
Among the data collected were the following behavior disorder scores on 27 patients treated with 
benzodiazepines (W) and 28 who were not (WO). 


У wo 

.00 1.00 .00 .00 
.00 1.00 .00 10.00 
.00 .00 .00 .00 
.00 .00 .00 18.00 
.00 10.00 .00 .00 
.00 2.00 .00 2.00 
.00 .00 5.00 
.00 .00 
.00 4.00 
.00 1.00 

4.00 2.00 

3.00 .00 

2.00 6.00 
.00 .00 

10.00 .00 

2.00 1.00 
.00 2.00 

9.00 1.00 
.00 22.00 

o P Source: Data provided courtesy 


of Dr. Yochi Shmuely. 
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54. 


55. 


The objective of a study by Reinecke et al. (A-59) was to investigate the functional activity and 
expression of the sarcolemmal Nat / Ca?* exchange in the failing human heart. The researchers 
obtained left ventricular samples from failing human hearts of 11 male patients (mean age 51 years) 
undergoing cardiac transplantation. Nonfailing control hearts were obtained from organ donors (four 
females, two males, mean age 41 years) whose hearts could not be transplanted for noncardiac 
reasons. The following are the Na* / Са?" exchanger activity measurements for the patients with end- 
stage heart failure (CHF) and nonfailing controls (NF). 


NF CHF 
0.075 0.221 
0.073 0.231 
0.167 0.145 
0.085 0.112 
0.110 0.170 
0.083 0.207 
0.112 
0.291 
0.164 
0.195 
0.185 


Source: Data provided courtesy of Dr. Hans Reinecke. 


Reichman et al. (A-60) conducted a study with the purpose of demonstrating that negative symptoms 
are prominent in patients with Alzheimer's disease and are distinct from depression. The following 
are scores made on the Scale for the Assessment of Negative Symptoms in Alzheimer's Disease by 
patients with Alzheimer's disease (PT) and normal elderly, cognitively intact, comparison 
subjects (C). 


PT С 
19 6 
5 5 
36 10 
22 1 
1 1 
18 0 
24 5 
17 5 
7 4 
19 6 
5 6 
2 7 
14 © 
9 3 
34 2 
13 12 


(Continued ) 
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PT C 
0 0 
21 5 
30 1 
43 2 
19 3 
31 19 
21 3 
41 5 
24 
3 Source: Data provided courtesy 


of Dr. Andrew C. Coyne. 


Exercises for Use with Large Data Sets Available on the Following Website: 
www.wiley.com/college/daniel 


Refer to the creatine phosphokinase data on 1005 subjects (PCKDATA). Researchers would like to 
know if psychologically stressful situations cause an increase in serum creatine phosphokinase 
(CPK) levels among apparently healthy individuals. To help the researchers reach a decision, select a 
simple random sample from this population, perform an appropriate analysis of the sample data, and 
give a narrative report of your findings and conclusions. Compare your results with those of your 
classmates. 


Refer to the prothrombin time data on 1000 infants (PROTHROM). Select a simple random sample of 
size 16 from each of these populations and conduct an appropriate hypothesis test to determine 
whether one should conclude that the two populations differ with respect to mean prothrombin time. 
Leto — .05. Compare your results with those of your classmates. What assumptions are necessary for 
the validity of the test? 


Refer to the head circumference data of 1000 matched subjects (HEADCIRC). Select a simple 
random sample of size 20 from the population and perform an appropriate hypothesis test to 
determine if one can conclude that subjects with the sex chromosome abnormality tend to have 
smaller heads than normal subjects. Let а — .05. Construct a 95 percent confidence interval for the 
population mean difference. What assumptions are necessary? Compare your results with those of 
your classmates. 


Refer to the hemoglobin data on 500 children with iron deficiency anemia and 500 apparently healthy 
children (HEMOGLOB). Select a simple random sample of size 16 from population A and an 
independent simple random sample of size 16 from population B. Does your sample data provide 
sufficient evidence to indicate that the two populations differ with respect to mean Hb value? Let 
о = .05. What assumptions are necessary for your procedure to be valid? Compare your results with 
those of your classmates. 


Refer to the manual dexterity scores of 500 children with learning disabilities and 500 children with 
no known learning disabilities (MANDEXT). Select a simple random sample of size 10 from 
population A and an independent simple random sample of size 15 from population B. Do your 
samples provide sufficient evidence for you to conclude that learning-disabled children, on the 
average, have lower manual dexterity scores than children without a learning disability? Let a = .05. 
What assumptions are necessary in order for your procedure to be valid? Compare your results with 
those of your classmates. 
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CHAPTER 8 


ANALYSIS OF VARIANCE 


CHAPTER OVERVIEW 


TOPICS 


This chapter introduces the first in a series of chapters devoted to linear 
models. The topic of this chapter, analysis of variance, provides a metho- 
dology for partitioning the total variance computed from a data set into 
components, each of which represents the amount of the total variance 
that can be attributed to a specific source of variation. The results of this 
partitioning can then be used to estimate and test hypotheses about popula- 
tion variances and means. In this chapter we focus our attention on hypothesis 
testing of means. Specifically, we discuss the testing of differences among 
means when there is interest in more than two populations or two or more 
variables. The techniques discussed in this chapter are widely used in the 
health sciences. 


8.1 INTRODUCTION 

8.2 THE COMPLETELY RANDOMIZED DESIGN 

8.3 THE RANDOMIZED COMPLETE BLOCK DESIGN 
8.4 THE REPEATED MEASURES DESIGN 

8.5 THE FACTORIAL EXPERIMENT 

8.6 SUMMARY 


LEARNING OUTCOMES 
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After studying this chapter, the student will 
1. understand the basic statistical concepts related to linear models. 


2. understand how the total variation in a data set can be partitioned into different 
components. 


3. be able to compare the means of more than two samples simultaneously. 
4. understand multiple comparison tests and when their use is appropriate. 
5. understand commonly used experimental designs. 
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8.1 INTRODUCTION 


In the preceding chapters the basic concepts of statistics have been examined, and they 
provide a foundation for this and the next several chapters. In this chapter and the three that 
follow, we provide an overview of two of the most commonly employed analytical tools 
used by applied statisticians, analysis of variance and linear regression. The conceptual 
foundations of these analytical tools are statistical models that provide useful representa- 
tions of the relationships among several variables simultaneously. 


Linear Models A statistical model is a mathematical representation of the relation- 
ships among variables. More specifically for the purposes of this book, a statistical model is 
most often used to describe how random variables are related to one another in a context in 
which the value of one outcome variable, often referred to with the letter “y,” can be 
modeled as a function of one or more explanatory variables, often referred to with the letter 
“x.” [n this way, we are interested in determining how much variability in outcomes can be 
explained by random variables that were measured or controlled as part of an experiment. 
The linear model can be expanded easily to the more generalized form, in which we include 
multiple outcome variables simultaneously. These models are referred to as General Linear 


Models, and can be found in more advanced statistics books. 


DEFINITION 


An outcome variable is represented by the set of measured values that 
result from an experiment or some other statistical process. An 
explanatory variable, on the other hand, is a variable that is useful for 
predicting the value of the outcome variable. 


A linear model is any model that is linear in the parameters that define the model. We 
can represent such models generically in the form: 


Y; = By + B1Xij + ВХ, +... + ӨХ Е; (8.1.1) 


In this equation, В; represents the coefficients in the model and e; represents random error. 
Therefore, any model that can be represented in this form, where the coefficients are 
constants and the algebraic order of the model is one, is considered a linear model. Though 
at first glance this equation may seem daunting, it actually is generally easy to find values 
for the parameters using basic algebra or calculus, as we shall see as the chapter progresses. 

We will see many representations of linear models in this and other forms in the next 
several chapters. In particular, we will focus on the use of linear models for analyzing data 
using the analysis of variance for testing differences among means, regression for making 
predictions, and correlation for understanding associations among variables. In the context 
of analysis of variance, the predictor variables are classification variables used to define 
factors of interest (e.g., differentiating between a control group and a treatment group), and 
in the context of correlation and linear regression the predictor variables are most often 
continuous variables, or at least variables at a higher level than nominal classes. Though the 
underlying purposes of these tasks may seem quite different, studying these techniques and 
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the structure of the models used to represent them will prove to be valuable for under- 
standing some of the most commonly used inferential statistics. 


Analysis of Variance This chapter is concerned with analysis of variance, which 
may be defined as a technique whereby the total variation present in a set of data is 
partitioned into two or more components. Associated with each of these components is a 
specific source of variation, so that in the analysis it is possible to ascertain the magnitude 
of the contributions of each of these sources to the total variation. 

The development of analysis of variance (ANOVA) is due mainly to the work of 
R. A. Fisher (1), whose contributions to statistics, spanning the years 1912 to 1962, have 
had a tremendous influence on modern statistical thought (2,3). 


Applications Analysis of variance finds its widest application in the analysis of 
data derived from experiments. The principles of the design of experiments are well 
covered in many books, including those by Hinkelmann and Kempthorne (4), 
Montgomery (5), and Myers and Well (6). We do not study this topic in detail, since 
to do it justice would require a minimum of an additional chapter. Some of the important 
concepts in experimental design, however, will become apparent as we discuss analysis 
of variance. 

Analysis of variance is used for two different purposes: (1) to estimate and test 
hypotheses about population variances, and (2) to estimate and test hypotheses about 
population means. We are concerned here with the latter use. However, as we will see, 
our conclusions regarding the means will depend on the magnitudes of the observed 
variances. 

The concepts and techniques that we cover under the heading of analysis of variance 
are extensions of the concepts and techniques covered in Chapter 7. In Chapter 7 we 
learned to test the null hypothesis that two means are equal. In this chapter we learn to test 
the null hypothesis that three or more means are equal. Whereas, for example, what we 
learned in Chapter 7 enables us to determine if we can conclude that two treatments differ 
in effectiveness, what we learn in this chapter enables us to determine if we can conclude 
that three or more treatments differ in effectiveness. The following example illustrates 
some basic ideas involved in the application of analysis of variance. These will be extended 
and elaborated on later in this chapter. 


EXAMPLE 8.1.1 


Suppose we wish to know if three drugs differ in their effectiveness in lowering serum 
cholesterol in human subjects. Some subjects receive drug A, some drug B, and some drug 
C. After a specified period of time, measurements are taken to determine the extent to 
which serum cholesterol was reduced in each subject. We find that the amount by which 
serum cholesterol was lowered is not the same in all subjects. In other words, there is 
variability among the measurements. Why, we ask ourselves, are the measurements not all 
the same? Presumably, one reason they are not the same is that the subjects received 
different drugs. We now look at the measurements of those subjects who received drug A. 
We find that the amount by which serum cholesterol was lowered is not the same among 
these subjects. We find this to be the case when we look at the measurements for subjects 


8.1 INTRODUCTION. 307 


who received drug B and those subjects who received drug C. We see that there is 
variability among the measurements within the treatment groups. Why, we ask ourselves 
again, are these measurements not the same? Among the reasons that come to mind are 
differences in the genetic makeup of the subjects and differences in their diets. Through an 
analysis of the variability that we have observed, we will be able to reach a conclusion 
regarding the equivalence of the effectiveness of the three drugs. To do this we employ the 
techniques and concepts of analysis of variance. E 


Variables In our example we allude to three kinds of variables. We find these 
variables to be present in all situations in which the use of analysis of variance is 
appropriate. First, we have the treatment variable, which in our example was “drug.” 
We had three *values" of this variable, drug A, drug B, and drug C. The second kind of 
variable we refer to is the response variable. In the example it is change in serum 
cholesterol. The response variable is the variable that we expect to exhibit different values 
when different “values” of the treatment variable are employed. Finally, we have the other 
variables that we mention—genetic composition and diet. These are called extraneous 
variables. These variables may have an effect on the response variable, but they are not the 
focus of our attention in the experiment. The treatment variable is the variable of primary 
concern, and the question to be answered is: Do the different “values” of the treatment 
variable result in differences, on the average, in the response variable? 


Assumptions Underlying the valid use of analysis of variance as a tool of statistical 
inference is a set of fundamental assumptions. Although an experimenter must not expect 
to find all the assumptions met to perfection, it is important that the user of analysis of 
variance techniques be aware of the underlying assumptions and be able to recognize when 
they are substantially unsatisfied. Because experiments in which all the assumptions are 
perfectly met are rare, analysis of variance results should be considered as approximate 
rather than exact. These assumptions are pointed out at appropriate points in the 
following sections. 

We discuss analysis of variance as it is used to analyze the results of two different 
experimental designs, the completely randomized and the randomized complete block 
designs. In addition to these, the concept of a factorial experiment is given through its use in 
a completely randomized design. These do not exhaust the possibilities. A discussion of 
additional designs may be found in the references (4—6). 


The ANOVA Procedure In our presentation of the analysis of variance for the 
different designs, we follow the ten-step procedure presented in Chapter 7. The following is 
a restatement of the steps of the procedure, including some new concepts necessary for its 
adaptation to analysis of variance. 


1. Description of data. In addition to describing the data in the usual way, we display 
the sample data in tabular form. 


2. Assumptions. Along with the assumptions underlying the analysis, we present the 
model for each design we discuss. The model consists of a symbolic representation 
of a typical value from the data being analyzed. 


3. Hypotheses. 
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Test statistic. 
Distribution of test statistic. 


Decision rule. 


DU gum x 


Calculation of test statistic. The results of the arithmetic calculations will be 
summarized in a table called the analysis of variance (ANOVA) table. The entries in 
the table make it easy to evaluate the results of the analysis. 


8. Statistical decision. 
9. Conclusion. 
10. Determination of p value. 


We discuss these steps in greater detail in Section 8.2. 


The Use of Computers The calculations required by analysis of variance are 
lengthier and more complicated than those we have encountered in preceding chapters. 
For this reason the computer assumes an important role in analysis of variance. All the 
exercises appearing in this chapter are suitable for computer analysis and may be solved 
with the statistical packages mentioned in Chapter 1. The output of the statistical 
packages may vary slightly from that presented in this chapter, but this should pose no 
major problem to those who use a computer to analyze the data of the exercises. The 
basic concepts of analysis of variance that we present here should provide the necessary 
background for understanding the description of the programs and their output in any of 
the statistical packages. 


8.2 THE COMPLETELY RANDOMIZED DESIGN 


We saw in Chapter 7 how it is possible to test the null hypothesis of no difference between 
two population means. It is not unusual for the investigator to be interested in testing the 
null hypothesis of no difference among several population means. The student first 
encountering this problem might be inclined to suggest that all possible pairs of sample 
means be tested separately by means of the Student 1 test. Suppose there are five 
populations involved. The number of possible pairs of sample means is ¿C2 = 10. As 
the amount of work involved in carrying out this many t tests is substantial, it would be 
worthwhile if a more efficient alternative for analysis were available. A more important 
consequence of performing all possible t tests, however, is that it is very likely to lead to a 
false conclusion. 

Suppose we draw five samples from populations having equal means. As we have 
seen, there would be 10 tests if we were to do each of the possible tests separately. If we 
select a significance level of o = .05 for each test, the probability of failing to reject a 
hypothesis of no difference in each case would be .95. By the multiplication rule of 
probability, if the tests were independent of one another, the probability of failing to reject a 
hypothesis of no difference in all 10 cases would be ( 95)? — .5987. The probability of 
rejecting at least one hypothesis of no difference, then, would be 1 — .5987 — .4013. Since 
we know that the null hypothesis is true in every case in this illustrative example, rejecting 
the null hypothesis constitutes the committing of a type I error. In the long run, then, in 
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testing all possible pairs of means from five samples, we would commit a type I error 
40 percent of the time. The problem becomes even more complicated in practice, since 
three or more t tests based on the same data would not be independent of one another. 

It becomes clear, then, that some other method for testing for a significant difference 
among several means is needed. Analysis of variance provides such a method. 


One-Way ANOVA . The simplest type of analysis of variance is that known as 
one-way analysis of variance, in which only one source of variation, or factor, is 
investigated. It is an extension to three or more samples of the ¢ test procedure (discussed 
in Chapter 7) for use with two independent samples. Stated another way, we can say that 
the f test for use with two independent samples is a special case of one-way analysis 
of variance. 

In a typical situation we want to use one-way analysis of variance to test the null 
hypothesis that three or more treatments are equally effective. The necessary experiment 
is designed in such a way that the treatments of interest are assigned completely at 
random to the subjects or objects on which the measurements to determine treatment 
effectiveness are to be made. For this reason the design is called the completely randomized 
experimental design. 

We may randomly allocate subjects to treatments as follows. Suppose we have 16 
subjects available to participate in an experiment in which we wish to compare four drugs. 
We number the subjects from 01 through 16. We then go to a table of random numbers and 
select 16 consecutive, unduplicated numbers between 01 and 16. To illustrate, let us use 
Appendix Table A and a random starting point that, say, is at the intersection of Row 4 and 
Columns 11 and 12. The two-digit number at this intersection is 98. The succeeding 
(moving downward) 16 consecutive two-digit numbers between 01 and 16 are 16, 09, 06, 
15, 14, 11, 02, 04, 10, 07, 05, 13, 03, 12, 01, and 08. We allocate subjects 16, 09, 06, and 15 
to drug A; subjects 14, 11, 02, and 04 to drug B; subjects 10, 07, 05, and 13 to drug C; and 
subjects 03, 12, 01, and 08 to drug D. We emphasize that the number of subjects in 
each treatment group does not have to be the same. Figure 8.2.1 illustrates the scheme of 
random allocation. 


Available 
subjects 


01 [о 03 || 04 || 05 || 06 || 07 || 08 || 09 || 10 || 11 || 12 13 || 14 || 15 | | 16 


Random Г [09 06 | 15 || 14 | 11 |102 | 04 || 10 | 07 || 05 | 13 || оз || 12 || 01 || ов 
numbers 

16 || 09 || 06 || 15 14 || 11 || 02 || 04 ло || 07 || 05 | | 13 оз || 12 || 01 || ов 
Treatment А В C D 


FIGURE 8.2.1 Allocation of subjects to treatments, completely randomized design. 
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TABLE 8.2.1 Table of Sample Values for the 
Completely Randomized Design 


Treatment 
1 2 3 k 
X11 X12 X13 X1k 
X2 X22 X23 X2k 
X31 X32 X33 X3k 
Хп Хп2 Хпзз Хпьк 
Total T4 T2 T3 T Т.к T. 


Mean X4 X2 X.3 n Хк X. 


Hypothesis Testing Steps Once we decide that the completely randomized 
design is the appropriate design, we may proceed with the hypothesis testing steps. We 
discuss these in detail first, and follow with an example. 


1. Description of data. The measurements (or observations) resulting from a 
completely randomized experimental design, along with the means and totals that 
can be computed from them, may be displayed for convenience as in Table 8.2.1. The 
symbols used in Table 8.2.1 are defined as follows: 


ху = the ith observation resulting from the jth treatment 
(there are a total of k treatments) 


і = 1,2,...,п j=1,2,...,k 


nj 
Туш У и = total of the ¡th treatment 
¡=1 


T у 
ху = — = mean of the jth treatment 
n; 
j 
k k пі 
у= Ту= 5 xij = total of all observations 
j=l j=l i=l 
T k 
x=, N= nj 
N 41 


2. Assumptions. Before stating the assumptions, let us specify the model for the 
experiment described here. 


The Model ^s already noted, a model is a symbolic representation of a typical value of 
a data set. To write down the model for the completely randomized experimental design, let 
us begin by identifying a typical value from the set of data represented by the sample 
displayed in Table 8.2.1. We use the symbol xj; to represent this typical value. 
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The one-way analysis of variance model may be written as follows: 
хі = U + Tj + €ij; i=1,2,...,n;, j E12; (8.2.1) 


The terms in this model are defined as follows: 


1. и represents the mean of all k population means апа is called the grand mean. 


2. ту represents the difference between the mean of the jth population and the grand 
mean and is called the treatment effect. 


3. є; represents the amount by which an individual measurement differs from the mean 
of the population to which it belongs and is called the error term. 


Components of the Model By looking at our model we can see that a typical 
Observation from the total set of data under study is composed of (1) the grand mean, (2) a 
treatment effect, and (3) an error term representing the deviation of the observation from its 
group mean. 

In most situations we are interested only in the k treatments represented in our 
experiment. Any inferences that we make apply only to these treatments. We do not wish to 
extend our inference to any larger collection of treatments. When we place such a 
restriction on our inference goals, we refer to our model as the fixed-effects model, or 
model 1. The discussion in this book is limited to this model. 


Assumptions of the Model The assumptions for the fixed-effects model are as 
follows: 


(a) The k sets of observed data constitute k independent random samples from the 
respective populations. 


(b) Each of the populations from which the samples come is normally distributed with 


mean иу and variance oj. 


(c) Each of the populations has the same variance. That is, 02 = 02 = ...02 = o? the 
common variance. 


(d) The z; are unknown constants and y т; = 0 since the sum of all deviations of the Hj 
from their mean, и, is zero. 


(e) The ej; have a mean of 0, since the mean of ху is Ш. 


(f) The єї; have a variance equal to the variance of ће хуу, since the єї; and xj; differ only 
by a constant; that is, the error variance is equal to o?, the common variance specified 
in assumption c. 


(g) The є; are normally (and independently) distributed. 
3. Hypotheses. We test the null hypothesis that all population or treatment means 


are equal against the alternative that the members of at least one pair are not equal. 
We may state the hypotheses formally as follows: 


Но: шщ = ш = = Mg 


Ha : not all и; are equal 
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Hy = Ha = .-. = № 


FIGURE 8.2.2 Picture of the populations represented in 
a completely randomized design when Но is true and the 
assumptions are met. 


If the population means are equal, each treatment effect is equal to zero, so that, 
alternatively, the hypotheses may be stated as 


Но: tj = 0, JjzÉd2;k 
Ha : not allt; = 0 


If Ho is true and the assumptions of equal variances and normally distributed 
populations are met, a picture of the populations will look like Figure 8.2.2. When Ho 
is true the population means are all equal, and the populations are centered at the 
same point (the common mean) on the horizontal axis. If the populations are all 
normally distributed with equal variances the distributions will be identical, so that in 
drawing their pictures each is superimposed on each of the others, and a single 
picture sufficiently represents them all. 

When Ho is false it may be false because one of the population means is different 
from the others, which are all equal. Or, perhaps, all the population means are different. 
These are only two of the possibilities when Но is false. There are many other possible 
combinations of equal and unequal means. Figure 8.2.3 shows a picture of the 
populations when the assumptions are met, but Но is false because no two population 
means are equal. 


4. Test statistic. The test statistic for one-way analysis of variance is a computed 
variance ratio, which we designate by V.R. as we did in Chapter 7. The two 


І І І 

Ш Ha td ugh og Hk 
FIGURE 8.2.3 Picture of the populations represented in a 
completely randomized design when the assumptions of equal 
variances and normally distributed populations are met, but Но is 
false because none of the population means are equal. 
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variances from which V.R. is calculated are themselves computed from the sample 
data. The methods by which they are calculated will be given in the discussion that 
follows. 


5. Distribution of test statistic. As discussed in Section 7.8, V.R. is distributed as the 
F distribution when Но is true and the assumptions are met. 


6. Decision rule. In general, the decision rule is: reject the null hypothesis if the 
computed value of V.R. is equal to or greater than the critical value of F for the 
chosen o level. 


7. Calculation of test statistic. We have defined analysis of variance as a process 
whereby the total variation present in a set of data is partitioned into components that 
are attributable to different sources. The term variation used in this context refers 
to the sum of squared deviations of observations from their mean, or sum of squares 
for short. 


The initial computations performed in one-way ANOVA consist of the partitioning of 
the total variation present in the observed data into its basic components, each of which is 
attributable to an identifiable source. 

Those who use a computer for calculations may wish to skip the following discussion 
of the computations involved in obtaining the test statistic. 


The Total Sum of Squares Before we can do any partitioning, we must first 
obtain the total sum of squares. The total sum of squares is the sum of the squares of the 
deviations of individual observations from the mean of all the observations taken together. 
This total sum of squares is defined as 


k п) 
55т = Y у (xj ох (8.2.2) 


j=l i=l 


where ye ¡ tells us to sum the squared deviations for each treatment group, and 5 tells us 
to add the k group totals obtained by applying >, The reader will recognize Equation 
8.22 as the numerator of the variance that may be computed from the complete set of 
observations taken together. 


The Within Groups Sum of Squares Now let us show how to compute the 
first of the two components of the total sum of squares. 

The first step in the computation calls for performing certain calculations within each 
group. These calculations involve computing within each group the sum of the squared 
deviations of the individual observations from their mean. When these calculations have 
been performed within each group, we obtain the sum of the individual group results. This 
component of variation is called the within groups sum of squares and may be designated 
SSW. This quantity is sometimes referred to as the residual or error sum of squares. The 
expression for these calculations is written as follows: 


k ту 
ssw = Y (ay -xj) (8.2.3) 


j=l i=l 
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The Among Groups Sum of Squares To obtain the second component of 
the total sum of squares, we compute for each group the squared deviation of the group 
mean from the grand mean and multiply the result by the size of the group. Finally, we add 
these results over all groups. This quantity is a measure of the variation among groups and 
is referred to as the sum of squares among groups or SSA. The formula for calculating this 
quantity is as follows: 


k 
SSA = У nx; - x.) (8.2.4) 


= 


In summary, then, we have found that the total sum of squares is equal to the sum of 
the among and the within sum of squares. We express this relationship as follows: 


SST = SSA + SSW 


From the sums of squares that we have now learned to compute, it is possible to obtain two 
estimates of the common population variance, o?. It can be shown that when the 
assumptions are met and the population means are all equal, both the among sum of 
squares and the within sum of squares, when divided by their respective degrees of 
freedom, yield independent and unbiased estimates of o?. 


The First Estimate of о? Within any sample, 


provides an unbiased estimate of the true variance of the population from which the sample 
came. Under the assumption that the population variances are all equal, we may pool ће k 
estimates to obtain 


Ма (8.2.5) 


This is our first estimate of o? and may be called the within groups variance, since it is 
the within groups sum of squares of Equation 8.2.3 divided by the appropriate degrees of 
freedom. The student will recognize this as an extension to k samples of the pooling of 
variances procedure encountered in Chapters 6 and 7 when the variances from two 
samples were pooled in order to use the ¢ distribution. The quantity in Equation 8.2.5 
is customarily referred to as the within groups mean square rather than the within 
groups variance. 
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The within groups mean square is a valid estimate of o? only if the population 
variances are equal. It is not necessary, however, for Но to be true in order for the within 
groups mean square to be a valid estimate of o?; that is, the within groups mean square 
estimates o? regardless of whether Ho is true or false, as long as the population variances 
are equal. 


The Second Estimate of o? The second estimate of o? may be obtained from 


the familiar formula for the variance of sample means, o? — o?/n. If we solve this 


x 
equation for o?, the variance of the population from which the samples were drawn, we 


have 
o? = no? (8.2.6) 


An unbiased estimate of 0? computed from sample data is provided by 


If we substitute this quantity into Equation 8.2.6, we obtain the desired estimate 
of о?, 


nM (ux) 


MSA = (8.2.7) 


k—1 


The reader will recognize the numerator of Equation 8.2.7 as the among groups 
sum of squares for the special case when all sample sizes are equal. This sum of squares 
when divided by the associated degrees of freedom k — 1 is referred to as the among groups 
mean square. 

When the sample sizes are not all equal, an estimate of o? based on the variability 
among sample means is provided by 


(8.2.8) 


If, indeed, the null hypothesis is true we would expect these two estimates of o? to be 
fairly close in magnitude. If the null hypothesis is false, that is, if all population means are 
not equal, we would expect the among groups mean square, which is computed by using the 
squared deviations of the sample means from the overall mean, to be larger than the within 
groups mean square. 

In order to understand analysis of variance we must realize that the among groups 
mean square provides a valid estimate of o? when the assumption of equal population 
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variances is met and when Hy is true. Both conditions, a true null hypothesis and equal 
population variances, must be met in order for the among groups mean square to be a valid 
estimate of o?. 


The Variance Ratio What we need to do now is to compare these two estimates of 
о?, and we do this by computing the following variance ratio, which is the desired 
test statistic: 


Ув — among groups mean square MSA 


` within groups mean square MSW 


If the two estimates are about equal, V.R. will be close to 1. A ratio close to 1 tends to 
support the hypothesis of equal population means. If, on the other hand, the among groups 
mean square is considerably larger than the within groups mean square, V.R. will be 
considerably greater than 1. A value of V.R. sufficiently greater than 1 will cast doubt on the 
hypothesis of equal population means. 

We know that because of the vagaries of sampling, even when the null hypothesis is 
true, it is unlikely that the among and within groups mean squares will be equal. We must 
decide, then, how big the observed difference must be before we can conclude that the 
difference is due to something other than sampling fluctuation. In other words, how large a 
value of V.R. is required for us to be willing to conclude that the observed difference 
between our two estimates of o? is not the result of chance alone? 


The F Test To answer the question just posed, we must consider the sampling 
distribution of the ratio of two sample variances. In Chapter 6 we learned that the quantity 
(82/01) / (5/03) follows a distribution known as ће F distribution when the sample 
variances are computed from random and independently drawn samples from normal 
populations. The F distribution, introduced by R. A. Fisher in the early 1920s, has become 
one of the most widely used distributions in modern statistics. We have already become 
acquainted with its use in constructing confidence intervals for, and testing hypotheses 
about, population variances. In this chapter, we will see that it is the distribution 
fundamental to analysis of variance. For this reason the ratio that we designate V.R. is 
frequently referred to as F, and the testing procedure is frequently called the F test. It is of 
interest to note that the F distribution is the ratio of two Chi-square distributions. 

In Chapter 7 we learned that when the population variances are the same, they cancel 
in the expression (51/01) / (55/03), leaving 7/8, which is itself distributed as F. The F 
distribution is really a family of distributions, and the particular F distribution we use in a 
given situation depends on the number of degrees of freedom associated with the sample 
variance in the numerator (numerator degrees of freedom) and the number of degrees 
of freedom associated with the sample variance in the denominator (denominator degrees 
of freedom). 

Once the appropriate F distribution has been determined, the size of the 
observed V.R. that will cause rejection of the hypothesis of equal population variances 
depends on the significance level chosen. The significance level chosen determines 
the critical value of F, the value that separates the nonrejection region from the 
rejection region. 
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TABLE 8.2.2 Analysis of Variance Table for the Completely Randomized Design 


Source of Degrees of Variance 
Variation Sum of Squares Freedom Mean Square Ratio 
k 
Among samples SSA- У nj(x;- xy k-1 MSA = 55А/(К — 1) V.R SMSA 
A MSW 
k nj 2 
Within samples SSW = У У (ху - xj) N-k MSW = SSW/(N — k) 
j=1 іл 
k nj 2 
Total SST => У. (xi - X.) N-1 


As we have seen, we compute V.R. in situations of this type by placing the among 
groups mean square in the numerator and the within groups mean square in the denominator, 
so that the numerator degrees of freedom is equal to (k — 1), the number of groups minus 1, 
and the denominator degrees of freedom value is equal to 


k 


(= 1) = (>) =k=N-k 


Ј=1 


The ANOVA Table The calculations that we perform may be summarized апа 
displayed in a table such as Table 8.2.2 , which is called the ANOVA table. 


8. Statistical decision. To reach a decision we must compare our computed V.R. 
with the critical value of F, which we obtain by entering Appendix Table G 
with k — 1 numerator degrees of freedom and N — k denominator degrees of 
freedom. 


If the computed V.R. is equal to or greater than the critical value of F, we reject the null 
hypothesis. If the computed value of V.R. is smaller than the critical value of F, we do not 
reject the null hypothesis. 


Explaining a Rejected Null Hypothesis There are two possible explan- 
ations for a rejected null hypothesis. If the null hypothesis is true, that is, if the two sample 
variances are estimates of a common variance, we know that the probability of getting a 
value of V.R. as large as or larger than the critical F is equal to our chosen level of 
significance. When we reject Ho we may, if we wish, conclude that the null hypothesis is 
true and assume that because of chance we got a set of data that gave rise to a rare event. On 
the other hand, we may prefer to take the position that our large computed V.R. value does 
not represent a rare event brought about by chance but, instead, reflects the fact that 
something other than chance is operative. We then conclude that we have a false null 
hypothesis. 

It is this latter explanation that we usually give for computed values of V.R. that 
exceed the critical value of F. In other words, if the computed value of V.R. is greater than 
the critical value of F, we reject the null hypothesis. 
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It will be recalled that the original hypothesis we set out to test was 
Но: ш = by = ``: = My 


Does rejection of the hypothesis about variances imply a rejection of the hypothesis of 
equal population means? The answer is yes. A large value of V.R. resulted from the fact that 
the among groups mean square was considerably larger than the within groups mean 
square. Since the among groups mean square is based on the dispersion of the sample 
means about their mean (called the grand mean), this quantity will be large when there is a 
large discrepancy among the sizes of the sample means. Because of this, then, a significant 
value of V.R. tells us to reject the null hypothesis that all population means are equal. 


9. Conclusion. When we reject Ho, we conclude that not all population means are 
equal. When we fail to reject Ho, we conclude that the population means are not 
significantly different from each other. 


10. Determination of p value. 


EXAMPLE 8.2.1 


Game meats, including those from white-tailed deer and eastern gray squirrels, are used as 
food by families, hunters, and other individuals for health, cultural, or personal reasons. A 
study by David Holben (A-1) assessed the selenium content of meat from free-roaming 
white-tailed deer (venison) and gray squirrel (squirrel) obtained from a low selenium 
region of the United States. These selenium content values were also compared to those of 
beef produced within and outside the same region. We want to know if the selenium levels 
are different among the four meat groups. 


Solution: 


1. Description of data. Selenium content of raw venison (VEN), squirrel 
meat (SQU), region-raised beef (RRB), and nonregion-raised beef 
(NRB), in 4g/100g of dry weight, are shown in Table 8.2.3. A graph 
of the data in the form of a dotplot is shown in Figure 8.2.4. Such a graph 
highlights the main features of the data and brings into clear focus 
differences in selenium levels among the different meats. 


TABLE 8.2.3 Selenium Content, in /9/1004, of Four Different Meat Types 


Meat Type 
VEN SQU RRB NRB 
26.72 14.86 37.42 37.57 11.23 15.82 44. 33 
28.58 16.47 56.46 25.71 29.63 27.74 76.86 
29.71 25.19 51.91 23.97 20.42 22.35 4.45 
26.95 37.45 62.73 13.82 10.12 34.78 55.01 
10.97 45.08 4.55 42.21 39.91 35.09 58.21 
21.97 25.22 39.17 35.88 32.66 32.60 74.72 


(Continued) 
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Meat Type 
VEN SQU RRB NRB 
14.35 22.11 38.44 10.54 38.38 37.03 11.84 
32.21 33.01 40.92 27.97 36.21 27.00 139.09 
19.19 31.20 58.93 41.89 16.39 44.20 69.01 
30.92 26.50 61.88 23.94 27.44 13.09 94.61 
10.42 32.77 49.54 49.81 17.29 33.03 48.35 
35.49 8.70 64.35 30.71 56.20 9.69 37.65 
36.84 25.90 82.49 50.00 28.94 32.45 66.36 
25.03 29.80 38.54 87.50 20.11 37.38 72.48 
33.59 37.63 39.53 68.99 25.35 34.91 87.09 
33.74 21.69 21.77 27.99 26.34 
18.02 21.49 31.62 22.36 71.24 
22.27 18.11 32.63 22.68 90.38 
26.10 31.50 30.31 26.52 50.86 
20.89 27.36 46.16 46.01 
29.44 21.33 56.61 38.04 
24.47 30.88 
29.39 30.04 
40.71 25.91 
18.52 18.54 
27.80 25.51 
19.49 


Source: Data provided courtesy of David H. Holben, Ph.D. 


2. Assumptions. We assume that the four sets of data constitute indepen- 
dent simple random samples from the four indicated populations. We 
assume that the four populations of measurements are normally distrib- 
uted with equal variances. 
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FIGURE 8.2.4 Selenium content of four meat types. VEN = venison, SOU = squirrel, RRB = 
region-raised beef, and NRB — nonregion-raised beef. 
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TABLE 8.2.4 ANOVA Table for Example 8.2.1 


Source 


SS df MS F 


Among samples 
Within samples 
Total 


21261.82886 3  7087.27629 27.00 
36747.22674 140 262.48019 
58009.05560 143 


Hypotheses. Ho : шу = м» = из = u4 (On average the four meats have 
the same selenium content.) 


На: Not all jz’s are equal (At least one meat yields an average selenium 
content different from the average selenium content of at least one 
other meat.) 

Test statistic. The test statistic is V.R. — M$A/MSW. 


Distribution of test statistic. If Но 15 true and the assumptions are met, 
the V.R. follows the F distribution with 4 — 1 — 3 numerator degrees of 
freedom and 144 — 4 — 140 denominator degrees of freedom. 


Decision rule. Suppose we let а = .01. The critical value of F from 
Appendix Table С is « 3.95. The decision rule, then, is reject Но if the 
computed V.R. statistic is equal to or greater than 3.95. 


Calculation of test statistic. By Equation 8.2.2 we compute 
SST — 58009.05560 
By Equation 8.2.4 we compute 
SSA — 21261.82886 
SSW — 58009.05560 — 21261.82886 — 36747.22674 


The results of our calculations are displayed in Table 8.2.4. 
Statistical decision. Since our computed F of 27.00 is greater than 3.95 
we reject Ho. 

Conclusion. Since we reject Ho, we conclude that the alternative 
hypothesis is true. That is, we conclude that the four meat types do 
not all have the same average selenium content. 


10. p value. Since 27.00 > 3.95, p < .01 for this test. ш 


A Word of Caution The completely randomized design is simple and, therefore, 
widely used. It should be used, however, only when the units receiving the treatments are 
homogeneous. If the experimental units are not homogeneous, the researcher should 
consider an alternative design such as one of those to be discussed later in this chapter. 

In our illustrative example the treatments are treatments in the usual sense of the 
word. This is not always the case, however, as the term “treatment” as used in experimental 
design is quite general. We might, for example, wish to study the response to the same 
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Dialog box: Session command: 


Stat » ANOVA » Oneway (Unstacked) MTB>AOVONEWAY C1-C4 


Type С/-С4 in responses (in separate columns) 
Click OK. 


Output: 

One-way ANOVA: NRB, RRB, SQU, VEN 

Analysis of Variance for Selenium 

Source SS MS F P 
Meat Typ 21262 27.00 0.000 
Error 36747 

Total 58009 


Individual CIs For Mean 


Based on Pooled StDev 


Pooled 


FIGURE 8.2.5 MINITAB procedure and output for Example 8.2.1. 


treatment (in the usual sense of the word) of several breeds of animals. We would, however, 
refer to the breed of animal as the "treatment." 

We must also point out that, although the techniques of analysis of variance are more 
often applied to data resulting from controlled experiments, the techniques also may be 
used to analyze data collected by a survey, provided that the underlying assumptions are 
reasonably well met. 


Computer Analysis Figure 82.5 shows the computer procedure and output for 
Example 8.2.1 provided by a one-way analysis of variance program found in the MINITAB 
package. The data were entered into Columns 1 through 4. When you compare the ANOVA 
table on this printout with the one given in Table 8.2.4, you see that the printout uses the 
label “factor” instead of “among samples." The different treatments are referred to on the 
printout as levels. Thus levell — treatment 1, level2 — treatment2, and so on. The 
printout gives the four sample means and standard deviations as well as the pooled 
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The SAS System 


Analysis of Variance Procedure 


Dependent 


Source 
Model 
Error 
Corrected 


Variable: selen 


Sum of 
DF Squares Mean Square F Value Pr » F 
3 21261.82886 7087.27629 27.00 <.0001 
140 36747.22674 262.48019 
Total 143 58009.05560 
R-Square Coeff Var Root MSE selen Mean 
0.366526 45.70507 16.20124 35.44736 


FIGURE 8.2.6 Partial SAS? printout for Example 8.2.1. 


standard deviation. This last quantity is equal to the square root of the error mean square 
shown in the ANOVA table. Finally, the computer output gives graphic representations of 
the 95% confidence intervals for the mean of each of the four populations represented by 
the sample data. 

Figure 8.2.6 contains a partial SAS® printout resulting from analysis of the data of 
Example 8.2.1 through use of the SAS® statement PROC ANOVA. SAS® computes some 
additional quantities as shown in the output. R-Square = SSA/SST. This quantity tells us 
what proportion of the total variability present in the observations is accounted for by 
differences in response to the treatments. C. V. = 100 (root MSE/selen mean). Root MSE is 
the square root of MSW, and selen mean is the mean of all observations. 

Note that the test statistic V.R. is labeled differently by different statistical 
software programs. MINITAB, for example, uses F rather than V.R. SAS® uses the 
label F Value. 

A useful device for displaying important characteristics of a set of data analyzed by 
one-way analysis of variance is a graph consisting of side-by-side boxplots. For each 
sample a boxplot is constructed using the method described in Chapter 2. Figure 8.2.7 
shows the side-by-side boxplots for Example 8.2.1. Note that in Figure 8.2.7 the variable of 
interest is represented by the vertical axis rather than the horizontal axis. 


Alternatives Ifthe data available for analysis do not meet the assumptions for one- 
way analysis of variance as discussed here, one may wish to consider the use of the 
Kruskal-Wallis procedure, a nonparametric technique discussed in Chapter 13. 


Testing for Significant Differences Between Individual Pairs of 
Means When the analysis of variance leads to a rejection of the null hypothesis 
of no difference among population means, the question naturally arises regarding just 
which pairs of means are different. In fact, the desire, more often than not, is to carry 
out a significance test on each and every pair of treatment means. For instance, in 
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FIGURE 8.2.7 Side-by-side boxplots for Example 8.2.1. 


Example 8.2.1, where there are four treatments, we may wish to know, after rejecting 
Ho: ш = M2 = Из = Ma, Which of the six possible individual hypotheses should be 
rejected. The experimenter, however, must exercise caution in testing for significant 
differences between individual means and must always make certain that the procedure 
is valid. The critical issue in the procedure is the level of significance. Although the 
probability, a, of rejecting a true null hypothesis for the test as a whole is made small, 
the probability of rejecting at least one true hypothesis when several pairs of means are 
tested is, as we have seen, greater than o. There are several multiple comparison 
procedures commonly used in practice. Below we illustrate two popular procedures, 
namely Tukey's HSD test and Bonferroni's method. The interested student is referred to 
the books by Hsu (7) and Westfall et al. (8) for additional techniques. 


Tukey's HSD Test Over the years several procedures for making multiple compari- 
sons have been suggested. A multiple comparison procedure developed by Tukey (9) is 
frequently used for testing the null hypothesis that all possible pairs of treatment means are 
equal when the samples are all of the same size. When this test is employed we select an 
overall significance level of o. The probability is a, then, that one or more of the null 
hypotheses is false. 

Tukey's test, which is usually referred to as the HSD (honestly significant difference) 
test, makes use of a single value against which all differences are compared. This value, 


called the HSD, is given by 
MSE 
HSD = qa k N-k ar (8.2.9) 


where o is the chosen level of significance, k is the number of means in the experiment, N is 
the total number of observations in the experiment, n is the number of observations in a 
treatment, MSE is the error or within mean square from the ANOVA table, and 4 is obtained 
by entering Appendix Table Н with o, К, and N — К. 
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The statistic q, tabulated in Appendix Table H, is known as the studentized range 
statistic. It is defined as the difference between the largest and smallest treatment means 
from an ANOVA (that is, it is the range of the treatment means) divided by the error mean 
square over n, the number of observations in a treatment. The studentized range is 
discussed in detail by Winer (10). 

All possible differences between pairs of means are computed, and any difference 
that yields an absolute value that exceeds HSD is declared significant. 


Tukey's Test for Unequal Sample Sizes When the samples are not all the 
same size, as is the case in Example 8.2.1, Tukey's HSD test given by Equation 8.2.9 is 
not applicable. Tukey himself (9) and Kramer (11), however, have extended the Tukey 
procedure to the case where the sample sizes are different. Their procedure, which is 
sometimes called the Tukey-Kramer method, consists of replacing MSE/n in Equation 
8.2.9 with (MSE/2) (1/n; + 1/n;), where n; and n; are the sample sizes of the two groups 
to be compared. If we designate the new quantity by HSD*, we have as the new 
test criterion 


К MSE (1 1 
HSD' = kac Е (8.2.10) 


2 т nj 


Any absolute value of the difference between two sample means that exceeds HSD* 
is declared significant. 


Bonferroni's Method Another very commonly used multiple comparison test 
is based on a method developed by C. E. Bonferroni. As with Tukey's method, we 
desire to maintain an overall significance level of o for the total of all pair-wise tests. 
In the Bonferroni method, we simply divide the desired significance level by the 
number of individual pairs that we are testing. That is, instead of testing at a 
significance level of a, we test at a significance level of w/k, where k is the number 
of paired comparisons. The sum of all «/k terms cannot, then, possibly exceed our 
stated level of o. For example, if one has three samples, A, B, and C, then there are 
К = 3 pair-wise comparisons. These аге ил = Ив, Ha = ис, and ив = ис. If we 
choose a significance level of о = .05, then we would proceed with the comparisons 
and use а Bonferroni-corrected significance level of 0/3 = .017. Therefore, our 
p value must be no greater then .017 in order to reject the null hypothesis and 
conclude that two means differ. 

Most computer packages compute values using the Bonferroni method and 
produce an output similar to the Tukey's HSD or other multiple comparison 
procedures. In general, these outputs report the actual corrected p value using the 
Bonferroni method. Given the basic relationship that p = a/k, then algebraically we 
can multiply both sides of the equation by К to obtain а = pk. In other words, 
the total о is simply the sum of all of the pk values, and the actual corrected p value 
is simply the calculated p value multiplied by the number of tests that were 
performed. 
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EXAMPLE 8.2.2 


Let us illustrate the use of the HSD test with the data from Example 8.2.1. 


Solution: The first step is to prepare a table of all possible (ordered) differences 
between means. The results of this step for the present example are displayed 
in Table 8.2.5. 


Suppose we let o = .05. Entering Table Н with o = .05, К = 4, and М — k = 140, we 
find that q < 3.68. The actual value is q — 3.667, which can be obtained from SAS®. 
In Table 8.2.4 we have MSE = 262.4802. 

The hypotheses that can be tested, the value of HSD*, and the statistical decision for 
each test are shown in Table 8.2.6. 

SAS® uses Tukey’s procedure to test the hypothesis of no difference between 
population means for all possible pair s of sample means. The output also contains 


TABLE 8.2.5 Differences Between Sample 
Means (Absolute Value) for Example 8.2.2 


VEN RRB SOR NRB 
VEN - 3.208 17.37 36.171 
RRB - 14.163 32.963 
SOU - 18.801 


NRB - 


TABLE 8.2.6 Multiple Comparison Tests Using Data of Example 8.2.1 and HSD* 


5319 32.963 > 11.23 


262. 4802 1 1 


30 ' 19 


Ho: изои = имяв HSD* = 3.677 = 12.32 Reject Но since 


18.801 > 12.32 


Hypotheses HSO* Statistical Decision 
Ho: ven = URRB HSD' = 3. Е as (= + 5) — 8.68 Do пої reject Но 
since 3.208 « 8.68 
262.4802 / 1 1 
Ho: uven = sou HSD* = 3. sm (5 H x) — 10.04 Reject Но since 
17.37 » 10.04 
262.4802 / 1 1 
Ho: ILyEN = I NRB HSD' = 3. E (5 + 5) = 11.61 Reject Ho since 
36.171 > 11.61 
262.4802 / 1 1 
Ho: иввв = MsoQu =3. о ser7 ®ы (ss + x) — 9.60 Reject Но since 
14.163 > 9.60 
262.4802 / 1 1 
Ho: иввв = MNRB HSD' — 3. sm ( H ) = 11.23 Reject Ho since 
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The SAS System 


Analysis of Variance Procedure 
Tukey’s Studentized Range (HSD) Test for selen 


т 


E: This test controls the Type І experimentwise error rate. 


Alpha 0.05 
Error Degrees of Freedom 140 
Error Mean Square 262.4802 
Critical Value of Studentized Range 3.67719 


Comparisons significant at the 0.05 level are indicated by ххх. 


Difference 
type Between Simultaneous 95$ 
Comparison Means Confidence Limits 


.801 .449 4152 
.963 .699 .228 
«т .524 .818 
.801 „152 ‚449 
‚163 ‚538 .787 
.370 .300 .440 
.963 .228 .699 
.163 .787 .538 
.208 .495 .910 
ET .818 .524 
.370 .440 .300 
.208 .910 .495 
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FIGURE 8.2.8 SAS? multiple comparisons for Example 8.2.1. 


confidence intervals for the difference between all possible pairs of population means. This 
SAS output for Example 8.2.1 is displayed in Figure 8.2.8. 

One may also use SPSS to perform multiple comparisons by a variety of methods, 
including Tukey's. The SPSS outputs for Tukey's HSD and Bonferroni's method for the 
data for Example 8.2.1 are shown in Figures 8.2.9 and 8.2.10, respectively. The outputs 
contain an exhaustive comparison of sample means, along with the associated standard 
errors, p values, and 9596 confidence intervals. Г] 


Dependent Variable: Selenium 


Multiple Comparisons 


Tukey HSD 
Mean 9596 Confidence Interval 
Difference 

(1) Meat type (J) Meat type (l-J) Std. Error | Sig. | Lower Bound | Upper Bound 

VEN SOU —17.370190* | 3.872837210 |.000 | —2744017302 — 430020793 
RRB —3.2075427 | 3.346936628 .773 | —11.91010145 5.49501609 
NRB —36.170840* | 4.479316382 |.000 | —4781776286 | —24.52391634 

SOU VEN 17.370190* | 3.872837210 |.000 7.30020793 27.44017302 
RRB 14.162648* | 3.701593729 |.001 4.53792509 23.78737051 
NRB —18.800649* | 4.750167007 |.001 |—31.15182638 —6.44947187 

RRB VEN 3.2075427 | 3.346936628 |.773 | —5.49501609 11.91010145 
SOU —14.162648* | 3.701593729 |.001 |-23.78737051 —4.53792509 
NRB —32.963297* | 4.332113033 |.000 |-44.22746845 | —21.69912540 

NRB VEN 36.170840* | 4.479316382 |.000 | 24.52391634 47.81776286 
SOU 18.800649* | 4.750167007 |.001 6.44947187 31.15182638 
RRB 32.963297* | 4.332113033 |.000 | 21.69912540 44.22746845 


* The mean difference is significant at the .05 level. 


FIGURE 8.2.9 SPSS output for Tukey's HSD using data from Example 8.2.1. 


Dependent Variable: Selenium 


Multiple Comparisons 


Bonferroni 
Mean 9596 Confidence Interval 
Difference 
(1) Meat type (J) Meat type (l-J) Std. Error | Sig. | Lower Bound | Upper Bound 
VEN RRB —3.20754 3.34694 1.000 —12.1648 5.7497 
500 —17.37019* 3.87284 .000 —27.7349 — 7.0055 
МАВ —36.17084* 4.47932 .000 —48.1587 —24.1830 
RRB VEN 3.20754 3.34694 1.000 —5.7497 12.1648 
500 —14.16265* 3.70159 .001 — 24.0691 —4.2562 
NRB —32.96330* 4.33211 .000 —44.5572 —21.3694 
SOU VEN 17.37019* 3.87284 .000 7.0055 27.7349 
RRB 14.16265* 3.70159 .001 4.2562 24.0691 
NRB —18.80065* 4.75017 .001 — 31.5134 — 6.0879 
NRB VEN 36.17084* 4.47932 .000 24.1830 48.1587 
RRB 32.96330* 4.33211 .000 21.3694 44.5572 
SQU 18.80065* 4.75017 .001 6.0879 31.5134 


*The mean difference is significant at the .05 level. 


FIGURE 8.2.10 SPSS output for Bonferroni’s method using data from Example 8.2.1. 
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EXERCISES 


8.2.1. 


In Exercise 8.2.1 to 8.2.7, go through the ten steps of analysis of variance hypothesis testing to see if 
you can conclude that there is a difference among population means. Let о = .05 for each test. Use 
Tukey’s HSD procedure to test for significant differences among individual pairs of means 
(if appropriate). Use the same « value for the F test. Construct a dot plot and side-by-side boxplots 
of the data. 


Researchers at Case Western Reserve University (A-2) wanted to develop and implement a 
transducer, manageable in a clinical setting, for quantifying isometric moments produced at the 
elbow joint by individuals with tetraplegia (paralysis or paresis of all four limbs). The apparatus, 
called an elbow moment transducer (EMT), measures the force the elbow can exert when flexing. The 
output variable is voltage. The machine was tested at four different elbow extension angles, 30, 60, 
90, and 120 degrees, on a mock elbow consisting of two hinged aluminum beams. The data are shown 
in the following table. 


Elbow Angle (Degrees) 
30 60 90 120 
—0.003 1.094 0.000 -0.001 0.000 —0.007 0.558 0.003 
0.050 1.061 0.053 0.010 0.006 0.012 0.529 0.062 
0.272 1.040 0.269 0.028 0.026 —0.039 0.524 0.287 
0.552 1.097 0.555 0.055 0.053 —0.080 0.555 0.555 
1.116 1.080 1.103 0.105 0.108 —0.118 0.539 1.118 
2.733 1.051 2.727 0.272 0.278 —0.291 0.536 2.163 
0.000 1.094 —0.002 0.553 0.555 —0.602 0.557 0.006 
0.056 1.075 0.052 0.840 0.834 —0.884 0.544 0.050 
0.275 1.035 0271 1.100 1.106 —1.176 0.539 0.277 
0.556 1.096 0.550 1.647 1.650 —1.725 1.109 0.557 
1.100 1.100 1.097 2.728 2.729 0.003 1.085 1.113 
2.723 1.096 2.725 —0.001 0.005 0.003 1.070 2.759 
—0.003 1.108 0.003 0.014 —0.023 —0.011 1.110 0.010 
0.055 1.099 0.052 0.027 —0.037 —0.060 1.069 0.060 
0.273 1.089 0.270 0.057 —0.046 —0.097 1.045 0.286 
0.553 1.107 0.553 0.111 —0.134 —0.320 1.110 0.564 
1.100 1.094 1.100 0.276 —0.297 —0.593 1.066 1.104 
2.713 1.092 2.727 0.555 —0.589 —0.840 1.037 2.760 
0.007 1.092 0.022 0.832 —0.876 — 1.168 2.728 —0.003 
—0.066 1.104 —0.075 1.099 —1.157 —1.760 2.694 —0.060 
—0.258 1.121 —0.298 1.651 —1.755 0.004 2.663 —0.289 
—0.581 1.106 —0.585 2.736 —2.862 0.566 2.724 —0.585 
—1.162 1.135 —1.168 0.564 0.000 1.116 2.693 —1.180 
0.008 1.143 0.017 0.556 0.245 2.762 2.670 0.000 
—0.045 1.106 —0.052 0.555 0.497 0.563 2.720 —0.034 
—0.274 1.135 —0.258 0.567 0.001 0.551 2.688 —0.295 
—0.604 1.156 —0.548 0.559 0.248 0.551 2.660 —0.579 
—1.143 1.112 —1.187 0.551 0.498 0.561 0.556 —1.165 
—0.004 1.104 0.019 1.107 0.001 0.555 0.560 —0.019 
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Elbow Angle (Degrees) 
30 60 90 120 

—0.050 1.107 —0.044 1.104 0.246 0.558 0.557 —0.056 
—0.290 1.107 —0.292 1.102 0.491 0.551 0.551 —0.270 
—0.607 1.104 —0.542 1.112 0.001 0.566 0.564 —0.579 
—1.164 1.117 —1.189 1.103 0.262 0.560 0.555 —1.162 

1.105 1.101 1.104 0.527 1.107 0.551 

1.103 1.114 0.001 1.104 0.563 

1.095 0.260 1.109 0.559 

1.100 0.523 1.108 1.113 

2.739 —0.005 1.106 1.114 

2.721 0.261 1.102 1.101 

2.687 0.523 1.111 1.113 

2.732 2.696 1.102 1.113 

2.702 2.664 1.107 1.097 

2.660 2.722 2.735 1.116 

2.743 2.686 2.733 1.112 

2.687 2.661 2.659 1.098 

2.656 0.548 2.727 2.732 

2.733 2.739 0.542 2:722 

2.731 2.742 0.556 2.734 

2.728 2.747 


Source: Data provided courtesy of S. A. Snyder, M.S. 


Patients suffering from rheumatic diseases or osteoporosis often suffer critical losses in bone mineral 
density (BMD). Alendronate is one medication prescribed to build or prevent further loss of BMD. 
Holcomb and Rothenberg (A-3) looked at 96 women taking alendronate to determine if a difference 
existed in the mean percent change in BMD among five different primary diagnosis classifications. 
Group 1 patients were diagnosed with rheumatoid arthritis (RA). Group 2 patients were a mixed 
collection of patients with diseases including lupus, Wegener's granulomatosis and polyarteritis, and 
other vasculitic diseases (LUPUS). Group 3 patients had polymyalgia rheumatica or temporal 
arthritis (PMRTA). Group 4 patients had osteoarthritis (OA) and group 5 patients had osteoporosis 
(O) with no other rheumatic diseases identified in the medical record. Changes in BMD are shown in 
the following table. 


Diagnosis 
RA LUPUS PMRTA OA O 
11.091 7.412 2.961 —3.669 11.146 2.937 
24.414 5.559 0.293 —7.816 —0.838 15.968 
10.025 4.761 8.394 4.563 4.082 5.349 
—3.156 —3.527 2.832 —0.093 6.645 1.719 
6.835 4.839 —1.369 —0.185 4.329 6.445 
3.321 1.850 11.288 1.302 1.234 20.243 
1.493 —3.933 3.997 5.299 —2.817 3.290 
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Diagnosis 
RA LUPUS PMRTA OA О 

—1.864 9.669 7.260 10.734 3.544 8.992 

5.386 4.659 5.546 1.399 4.160 6.120 

3.868 1.137 0.497 1.160 25.655 
6.209 7.521 0.592 —0.247 
—5.640 0.073 3.950 5.372 
3.514 —8.684 0.674 6.721 
—2.308 —0.372 9.354 9.950 
15.981 21.311 2.610 10.820 
—9.646 10.831 5.682 7.280 
5.188 3.351 6.605 
—1.892 9.557 7.507 
16.553 5.075 
0.163 
12.767 
3.481 
0.917 
15.853 


Source: Data provided courtesy of John P. Holcomb, Ph.D. and Ralph J. Rothenberg, M.D. 


Ilich-Ernst et al. (A-4) investigated dietary intake of calcium among a cross section of 113 healthy 
women ages 20-88. The researchers formed four age groupings as follows: Group A, 20.0-45.9 
years; group B, 46.0—55.9 years; group C, 56.0-65.9 years; and group D, over 66 years. Calcium from 
food intake was measured in mg/day. The data below are consistent with summary statistics given in 
the paper. 


Age Groups (Years) Age Groups (Years) 

A B с р А B c D 
1820 191 724 1652 1020 775 
2588 1098 613 1309 805 1393 
2670 644 918 1002 631 533 
1022 136 949 966 641 734 
1555 1605 877 788 760 485 

222 1247 1368 472 449 
1197 1529 1692 471 236 
1249 1422 697 TI 831 
1520 445 849 869 698 

489 990 1199 513 167 
2515 489 429 731 824 
1426 2408 798 1130 448 
1846 1064 631 1034 991 
1088 629 1016 1261 590 

912 1025 42 994 
1383 948 767 1781 
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Age Groups (Years) Age Groups (Years) 

A B c D A B c D 
1483 1085 752 937 
1723 775 804 1022 

727 1307 1182 1073 
1463 344 1243 948 
1777 961 985 222 
1129 239 1295 721 

944 1676 375 
1096 754 1187 


Gold et al. (A-5) investigated the effectiveness on smoking cessation of a nicotine patch, bupropion 
SR, or both, when co-administered with cognitive-behavioral therapy. Consecutive consenting 
patients (n = 164) assigned themselves to one of three treatments according to personal preference: 
nicotine patch (NTP, n = 13), bupropion SR (В; п - 92), and bupropion SR plus nicotine patch 
(BNTP, n — 59). At their first smoking cessation class, patients estimated the number of packs of 
cigarettes they currently smoked per day and the numbers of years they smoked. The “pack years” is 
the average number of packs the subject smoked per day multiplied by the number of years the subject 
had smoked. The results are shown in the following table. 


Pack Years 

NTP B BNTP 
15 8 60 90 8 80 
17 10 60 90 15 80 
18 15 60 90 25 82 
20 20 60 95 25 86 
20 22 60 96 25 87 
20 24 60 98 26 90 
30 25 60 98 30 90 
37 26 66 99 34 90 
43 27 66 100 35 90 
48 29 67 100 36 90 
60 30 68 100 40 95 
100 30 68 100 45 99 
100 35 70 100 45 100 
35 70 100 45 102 
39 70 105 45 105 
40 75 110 48 105 
40 75 110 48 105 
40 75 120 49 111 
40 75 120 52 113 
40 76 123 60 120 
40 80 125 60 120 
45 80 125 60 125 
45 80 126 64 125 
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8.2.6. 


Pack Years 
NTP B BNTP 

45 80 130 64 129 
50 80 130 70 130 
51 80 132 70 133 
52 80 132 70 135 
55 84 142 5 140 
58 84 157 75 154 
60 84 180 76 

60 90 


Source: Data provided courtesy of Paul B. Gold, Ph.D. 


In a study by Wang et al. (A-6), researchers examined bone strength. They collected 10 cadaveric 
femurs from subjects in three age groups: young (19-49 years), middle-aged (50-69 years), and 
elderly (70 years or older) [Note: one value was missing in the middle-aged group]. One of the 
outcome measures (W) was the force in Newtons required to fracture the bone. The following table 
shows the data for the three age groups. 


Young (Y) Middle-aged (MA) Elderly (E) 


193.6 125.4 59.0 
137.5 126.5 87.2 
122.0 115.9 84.4 
145.4 98.8 78.1 
117.0 94.3 51.9 
105.4 99.9 57.1 

99.9 83.3 54.7 

74.0 72.8 78.6 

74.4 83.5 53.7 
112.8 96.0 


Source: Data provided courtesy of Xiaodu Wang, Ph.D. 


In a study of 90 patients on renal dialysis, Farhad Atassi (A-7) assessed oral home care practices. He 
collected data from 30 subjects who were in (1) dialysis for less than 1 year, (2) dialysis for 1 to 3 
years, and (3) dialysis for more than 3 years. The following table shows plaque index scores for these 
subjects. A higher score indicates a greater amount of plaque. 


Group 1 Group 2 Group 3 
2.00 2.67 2.83 2.83 1.83 1.83 
1.00 2.17 2.00 1.83 2.00 2.67 
2.00 1.00 2.67 2.00 1.83 1.33 
1.50 2.00 2.00 1.83 1.83 2.17 
2.00 2.00 2.83 2.00 2.83 3.00 
1.00 2.00 2.17 2.17 2.17 2.33 
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Source: Data provided courtesy of Farhad Atassi, DDS, MSC, FICOI. 


Thrombocytopaenia is a condition of abnormally low platelets that often occurs during necrotizing 
enterocolitis (NEC)—a serious illness in infants that can cause tissue damage to the intestines. 
Ragazzi et al. (A-8) investigated differences in the log; of platelet counts in 178 infants with NEC. 
Patients were grouped into four categories of NEC status. Group O referred to infants with no 
gangrene, group 1 referred to subjects in whom gangrene was limited to a single intestinal segment, 
group 2 referred to patients with two or more intestinal segments of gangrene, and group 3 referred to 
patients with the majority of small and large bowel involved. The following table gives the logio 
platelet counts for these subjects. 


Gangrene Grouping 


0 1 2 3 
1.97 2.33 2.48 1.38 2.45 1.87 2.37 1.77 
0.85 2.60 2.23 1.86 2.60 1.90 1.75 1.68 
1.79 1.88 2.51 2.26 1.83 2.43 2.57 1.46 
2.30 2.33 2.38 1.99 2.47 1.32 1.51 1.53 
1.71 2.48 2.31 1.32 1.92 2.06 1.08 1.36 
2.66 2.15 2.08 2.11 2.51 1.04 2.36 1.65 
2.49 1.41 2.49 2.54 1.79 1.99 1.58 2.12 
2.37 2.03 2.21 2.06 2.17 1.52 1.83 1.73 
1.81 2.59 2.45 2.41 2.18 1.99 2.55 1.91 
2.51 2.23 1.96 2.23 2.53 2.52 1.80 1.57 
2.38 1.61 2.29 2.00 1.98 1.93 2.44 2.27 
2.58 1.86 2.54 2.74 1.93 2.29 2.81 1.00 
2.58 2.33 2.23 2.00 2.42 1.75 2.17 1.81 
2.84 2.34 2.78 2.51 0.79 2.16 2.72 2.27 
2.55 1.38 2.36 2.08 1.38 1.81 2.44 2.43 
1.90 2.52 1.89 2.46 1.98 1.74 
2.28 2.35 2.26 1.66 1.57 1.60 
2.33 2.63 1.79 2.51 2.05 2.08 
1:77 2.03 1.87 1.76 2.30 2.34 
1.83 1.08 2.51 1.72 1.36 1.89 
1.67 2.40 2.29 2:57 2.48 1.75 
2.67 1.77 2.38 2.30 1.40 1.69 
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82.8. 


8.2.9. 


Gangrene Grouping 


1.80 0.70 1.75 2.49 
2.16 2.67 1.75 
2.17 2.37 1.86 
2.12 1.46 1.26 
2.2] 1.91 2.36 


Source: Data provided courtesy of Simon Eaton, M.D. 


The objective of a study by Romita et al. (A-9) was to determine whether there is a different response 
to different calcium channel blockers. Two hundred and fifty patients with mild-to- 
moderate hypertension were randomly assigned to 4 weeks of treatment with once-daily doses 
of (1) lercanidipine, (2) felodipine, or (3) nifedipine. Prior to treatment and at the end of 4 weeks, each 
of the subjects had his or her systolic blood pressure measured. Researchers then calculated the 
change in systolic blood pressure. What is the treatment variable in this study? The response variable? 
What extraneous variables can you think of whose effects would be included in the error term? What 
are the “values” of the treatment variable? Construct an analysis of variance table in which you 
specify for this study the sources of variation and the degrees of freedom. 


Kosmiski et al. (A-10) conducted a study to examine body fat distributions of men infected and not 
infected with HIV, taking and not taking protease inhibitors (PI), and having been diagnosed and not 
diagnosed with lipodystrophy. Lipodystrophy is a syndrome associated with HIV/PI treatment that 
remains controversial. Generally, it refers to fat accumulation in the abdomen or viscera accompanied 
by insulin resistance, glucose intolerance, and dyslipidemia. In the study, 14 subjects were taking 
protease inhibitors and were diagnosed with lipodystrophy, 12 were taking protease inhibitors, but 
were not diagnosed with lipodystrophy, five were HIV positive, not taking protease inhibitors, nor 
had diagnosed lypodystrophy, and 43 subjects were HIV negative and not diagnosed with lipodys- 
trophy. Each of the subjects underwent body composition and fat distribution analyses by dual-energy 
X-ray absorptiometry and computed tomography. Researchers were able to then examine the percent 
of body fat in the trunk. What is the treatment variable? The response variable? What are the “values” 
of the treatment variable? Who are the subjects? What extraneous variables can you think of whose 
effects would be included in the error term? What was the purpose of including HIV-negative men in 
the study? Construct an ANOVA table in which you specify the sources of variation and the degrees of 
freedom for each. The authors reported a computed V.R. of 11.79. What is the p value for the test? 


8.3 THERANDOMIZED COMPLETE 
BLOCK DESIGN 


The randomized complete block design was developed about 1925 by R. A. Fisher, who was 
seeking methods of improving agricultural field experiments. The randomized complete 
block design is a design in which the units (called experimental units) to which the 
treatments are applied are subdivided into homogeneous groups called blocks, so that 
the number of experimental units in a block is equal to the number (or some multiple of the 
number) of treatments being studied. The treatments are then assigned at random to the 
experimental units within each block. It should be emphasized that each treatment appears 
in every block, and each block receives every treatment. 
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Objective The objective in using the randomized complete block design is to isolate 
and remove from the error term the variation attributable to the blocks, while assuring that 
treatment means will be free of block effects. The effectiveness of the design depends on the 
ability to achieve homogeneous blocks of experimental units. The ability to form homoge- 
neous blocks depends on the researcher’s knowledge of the experimental material. When 
blocking is used effectively, the error mean square in the ANOVA table will be reduced, the 
V.R. will be increased, and the chance of rejecting the null hypothesis will be improved. 

In animal experiments, the breed of animal may be used as a blocking factor. Litters 
may also be used as blocks, in which case an animal from each litter receives a treatment. In 
experiments involving human beings, if it is desired that differences resulting from age be 
eliminated, then subjects may be grouped according to age so that one person of each age 
receives each treatment. The randomized complete block design also may be employed 
effectively when an experiment must be carried out in more than one laboratory (block) or 
when several days (blocks) are required for completion. 

The random allocation of treatments to subjects is restricted in the randomized 
complete block design. That is, each treatment must be represented an equal number of 
times (one or more times) within each blocking unit. In practice this is generally 
accomplished by assigning a random permutation of the order of treatments to subjects 
within each block. For example, if there are four treatments representing three drugs and a 
placebo (drug A, drug B, drug C, and placebo [P]), then there are 4! — 24 possible 
permutations of the four treatments: (A, B, C, P) or (A, C, B, P) or (C, A, P, B), and so on. 
One permutation is then randomly assigned to each block. 


Advantages One of the advantages of the randomized complete block design is that 
it is easily understood. Furthermore, certain complications that may arise in the course of 
an experiment are easily handled when this design is employed. 

It is instructive here to point out that the paired comparisons analysis presented in 
Chapter 7 is a special case of the randomized complete block design. Example 7.4.1, for 
example, may be treated as a randomized complete block design in which the two points in 
time (Pre-op and Post-op) are the treatments and the individuals on whom the measure- 
ments were taken are the blocks. 


Data Display In general, the data from an experiment utilizing the randomized 
complete block design may be displayed in a table such as Table 8.3.1. The following new 
notation in this table should be observed: 


k 
total of the ith block = T; = У ^x; 
j=1 


k 
ў ху 
р Fi. 


k 


k n 
grand total = Т. = Ут, = Ут. 
j=l i=1 


mean of the ith block = x; = 
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TABLE 8.3.1 Table of Sample Values for the Randomized 
Complete Block Design 


Treatments 

Blocks 1 2 3 E k Total Mean 

X11 X12 X13 X1k Ti X1 
2 X2 X22 X23 X2k T? X2 
3 X31 X32 X33 X3k T3 X3 
n Хт Хр Xn3 Xnk Ти Xn 
Total T4 T» Тз T k T 
Mean X4 X2 X3 XK x 


indicating that the grand total may be obtained either by adding row totals or by adding 
column totals. 


Two-Way ANOVA The technique for analyzing the data from a randomized 
complete block design is called two-way analysis of variance since an observation is 
categorized on the basis of two criteria—the block to which it belongs as well as the 
treatment group to which it belongs. 

The steps for hypothesis testing when the randomized complete block design is used 
are as follows: 


1. Data. After identifying the treatments, the blocks, and the experimental units, the 
data, for convenience, may be displayed as in Table 8.3.1. 


2. Assumptions. The model for the randomized complete block design and its 
underlying assumptions are as follows: 


The Model 


xj = и + Bit Tj + Ej 


(8.3.1) 
i= T2 p j—52; ke 


In this model 


ху is a typical value from the overall population. 
ш is an unknown constant. 


В; represents a block effect reflecting the fact that the experimental unit fell in the ¡th 
block. 


t; represents a treatment effect, reflecting the fact that the experimental unit received 
the jth treatment. 


єў is a residual component representing all sources of variation other than treatments 
and blocks. 
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Assumptions of the Model 


(a) Each хі; that is observed constitutes a random independent sample of size 1 from one 
of the kn populations represented. 


(b) Each of these kn populations is normally distributed with mean ju; and the same 
variance o?. This implies that the Е are independently and normally distributed with 


mean 0 and variance o°. 


(c) The block and treatment effects are additive. This assumption may be interpreted to 
mean that there is no interaction between treatments and blocks. In other words, a 
particular block-treatment combination does not produce an effect that is greater or 
less than the sum of their individual effects. It can be shown that when this 
assumption is met, 


k n 
>. 9-2 5-0 
j=l i=l 


The consequences of a violation of this assumption are misleading results. One need 
not become concerned with the violation of the additivity assumption unless the 
largest mean is more than 50 percent greater than the smallest. 


When these assumptions hold true, the v; and В; are a set of fixed constants, and we have a 
situation that fits the fixed-effects model. 


3. Hypotheses. We may test 
Ho:1;—0, j=1,2,...,k 


against the alternative 


Ha : not all т; = 0 


A hypothesis test regarding block effects is not usually carried out under the 
assumptions of the fixed-effects model for two reasons. First, the primary interest is in 
treatment effects, the usual purpose of the blocks being to provide a means of eliminating 
an extraneous source of variation. Second, although the experimental units are randomly 
assigned to the treatments, the blocks are obtained in a nonrandom manner. 


4. Test statistic. The test statistic is V.R. 


5. Distribution of test statistic. When Но is true and the assumptions are met, V.R. 
follows an F distribution. 

6. Decision rule. Reject the null hypothesis if the computed value of the test statistic 
УК. is equal to or greater than the critical value of F. 


7. Calculation of test statistic. It can be shown that the total sum of squares for the 
randomized complete block design can be partitioned into three components, one 
each attributable to blocks (55В1), treatments (SSTr), and error (SSE). That 15, 


SST = SSBI + SSTr + SSE (8.3.2) 
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The formulas for the quantities in Equation 8.3.2 are as follows: 


k n 
ssT = Y Y (xy - 3.) (8.3.3) 
j=l i=l 


k n 
5581 = у M (жо —x. y (8.3.4) 
j=l il 
k n 3 
5577 = у у (x,— x) (8.3.5) 
j=l i=l 
SSE = SST — SSBI — SSTr (8.3.6) 


The appropriate degrees of freedom for each component of Equation 8.3.2 are 


total blocks treatments residual (error) 
kn-1 = (n-1) + (k-1) + (n—1)(k-1) 


The residual degrees of freedom, like the residual sum of squares, may be obtained 
by subtraction as follows: 


(kn — 1) -(n-1)-(k-1) =kn-1-n+1-k+1 
= n(k— 1) — 1(k— 1) = (n— 1)(к — 1) 


The ANOVA Table The results of the calculations for the randomized complete 
block design may be displayed in an ANOVA table such as Table 8.3.2. 


8. Statistical decision. It can be shown that when the fixed-effects model applies and 
the null hypothesis of no treatment effects (all т; = 0) is true, both the error, or 
residual, mean square and the treatments mean square are estimates of the common 
variance o?. When the null hypothesis is true, therefore, the quantity 


MSTr/MSE 


is distributed as F with k — 1 numerator degrees of freedom and (n — 1) x (k — 1) 
denominator degrees of freedom. The computed variance ratio, therefore, is com- 
pared with the critical value of F. 


TABLE 8.3.2 ANOVA Table for the Randomized Complete Block Design 


Source SS d.f. MS V.R. 
Treatments SSTr (k — 1) MSTr = SSTr/(k — 1) MSTr/MSE 
Blocks SSBI (n— 1) MSBI = SSBl/(n— 1) 

Residual SSE (n— 1)(k-1) MSE = 55Е/(п — 1)(k — 1) 


Total SST kn—1 
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9. Conclusion. If we reject Ho, we conclude that the alternative hypothesis is true. If 
we fail to reject Но, we conclude that Но may be true. 


10. p value. 


The following example illustrates the use of the randomized complete block 
design. 


EXAMPLE 8.3.1 


A physical therapist wished to compare three methods for teaching patients to use a certain 
prosthetic device. He felt that the rate of learning would be different for patients of different 
ages and wished to design an experiment in which the influence of age could be taken into 
account. 


Solution: The randomized complete block design is the appropriate design for this 
physical therapist. 


1. Data. Three patients in each of five age groups were selected to 
participate in the experiment, and one patient in each age group was 
randomly assigned to each of the teaching methods. The methods of 
instruction constitute our three treatments, and the five age groups are 
the blocks. The data shown in Table 8.3.3 were obtained. 


2. Assumptions. We assume that each of the 15 observations constitutes a 
simple random sample of size 1 from one of the 15 populations defined 
by a block-treatment combination. For example, we assume that the 
number 7 in the table constitute s a randomly selected response from a 
population of responses that would result if a population of subjects 
under the age of 20 received teaching method A. We assume that the 
responses in the 15 represented populations are normally distributed 
with equal variances. 


TABLE 8.3.3 Time (in Days) Required to Learn the Use 
of a Certain Prosthetic Device 


Teaching Method 


Age Group A B С Total Mean 
Under 20 7 9 10 26 8.67 
20 to 29 8 9 10 27 9.00 
30 to 39 9 9 12 30 10.00 
40 to 49 10 9 12 31 10.33 
50 and over 11 12 14 37 12.33 


Total 45 48 58 151 


Mean 9.0 9.6 11.6 10.07 
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3. Hypotheses. 


Но:т= 0 j=1,2,3 
Ha : not allt; = 0 


4. Test statistic. The test statistic is V.R. = MSTr/MSE. 


5. Distribution of test statistic. When Ho is true and the assumptions are 
met, V.R. follows an F distribution with 2 and 8 degrees of freedom. 


6. Decision rule. Let œ = .05. Reject the null hypothesis if the computed 
V.R. is equal to or greater than the critical F which we find in Appendix 
Table G to be 4.46. 


7. Calculation of test statistic. We compute the following sums of 
squares: 


SST = (7 — 10.07)? + (8 — 10.07? +... + (14 — 10.07)? = 46.9335 
SSBI = 3[(8.67 — 10.07)? + (9.00 — 10.07)? +... + (12.33 — 10.07)?] = 24.855 
SSTr = 5[(9 — 10.07)? + (9.6 — 10.07)? + (11.6 — 10.07)?] = 18.5335 


SSE — 46.9335 — 24.855 — 18.5335 — 3.545 


The degrees of freedom are total — (3)(5) — 1 — 14, blocks — 
5— 1 = 4, treatments = 3 — 1 = 2, and residual = (5 - 1)(3— 1) = 
8. The results of the calculations may be displayed in an ANOVA table 
as in Table 8.3.4 


8. Statistical decision. Since our computed variance ratio, 20.91, is 
greater than 4.46, we reject the null hypothesis of no treatment effects 
on the assumption that such a large V.R. reflects the fact that the two 
sample mean squares are not estimating the same quantity. The only 
other explanation for this large V.R. would be that the null hypothesis is 
really true, and we have just observed an unusual set of results. We rule 
out the second explanation in favor of the first. 


TABLE 8.3.4 ANOVA Table for Example 8.3.1 


Source SS d.f. MS V.R. 
Treatments 18.5335 2 9.26675 20.91 
Blocks 24.855 4 6.21375 

Residual 3.545 8 .443125 


Total 46.9335 14 
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9. Conclusion. We conclude that not all treatment effects are equal to zero, 
or equivalently, that not all treatment means are equal. 


10. p value. For this test p « .005. и 


Computer Analysis Most statistical software packages will analyze data from a 
randomized complete block design. We illustrate the input and output for MINITAB. We 
use the data from the experiment to set up a MINITAB worksheet consisting of three 
columns. Column 1 contains the observations, Column 2 contains numbers that identify the 
block to which each observation belongs, and Column 3 contains numbers that identify the 
treatment to which each observation belongs. Figure 8.3.1 shows the MINITAB worksheet 
for Example 8.3.1. Figure 8.3.2 contains the MINITAB dialog box that initiates the analysis 
and the resulting ANOVA table. 

The ANOVA table from the SAS? output for the analysis of Example 8.3.1 is 
shown in Figure 8.3.3 . Note that in this output the model SS is equal to the sum of SSBI 
and SSTr. 


Alternatives When the data available for analysis do not meet the assumptions of 
the randomized complete block design as discussed here, the Friedman procedure 
discussed in Chapter 13 may prove to be a suitable nonparametric alternative. 


Q 
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Q 
w 
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3 
4 
3 
6 
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ann & A 4 с б WN NY NY PR RR 
WN FP WN FP WN FP WYN FP с NP 


FIGURE 8.3.1 MINITAB worksheet for the data in Figure 8.3.2. 
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Dialog box: Session command: 


Stat » ANOVA » Twoway MTB » TWOWAY C1 C2 C3; 
SUBC » MEANS C2 C3. 


Type СІ in Response. Type C2 in Row factor and 
check Display means. Type C3 in Column factor and 
check Display means. Click OK. 


Output: 
Two-Way ANOVA: C1 versus C2, C3 


Analysis of Variance for C1 

Source DF SS 

c2 24.933 

C3 18.533 
3.467 

46.933 


FIGURE 8.3.2 MINITAB dialog box and output for two-way analysis of variance, Example 8.3.1. 


EXERCISES 


For Exercise 8.3.1 to 8.3.5 perform the ten-step hypothesis testing procedure for analysis of variance. 


8.3.1. The objective of a study by Brooks et al. (A-11) was to evaluate the efficacy of using a virtual 
kitchen for vocational training of people with learning disabilities. Twenty-four students participated 
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The SAS System 


Analysis of Variance Procedure 
Dependent Variable: DAYS 
Source DF Sum of Squares Mean Square 
Model 6 43.46666667 7.24444444 


Error 8 3.46666667 0.43333333 


Corrected Total 14 46.93333333 


R-Square (e Mis Root MSE DAYS Mean 


0.926136 6.539211 0.65828059 10.06666667 
Source Anova SS Mean Square Pr > F 


GROUP 18.53333333 9.26666667 0.0006 
AGE 24.93333333 6.23333333 0.0010 


FIGURE 8.3.3 Partial SAS? output for analysis of Example 8.3.1. 


in the study. Each participant performed four food preparation tasks and they were scored on the 
quality of the preparation. Then each participant received regular vocational training in food 
preparation (real training), virtual training using a TV and computer screen of a typical kitchen, 
workbook training with specialized reading materials, and no training (to serve as a control). After 
each of these trainings, the subjects were tested on food preparation. Improvement scores for each of 
the four training methods are shown in the following table. 


Subject Real Virtual Workbook No 
No. Training Training Training Training 
1 2 10 2 -4 
2 4 3 2 1 
3 4 13 0 1 
4 6 11 2 1 
5 5 13 5 1 
6 2 0 1 4 
7 10 17 2 6 
8 5 5 2 2 
9 10 4 5 2 
10 3 6 9 3 
11 11 9 8 7 
12 10 9 6 10 
13 5 8 4 1 


(Continued) 
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8.3.2. 


8.3.3. 


Subject Real Virtual Workbook No 
No. Training Training Training Training 
14 8 11 1 1 
15 4 8 5 2 
16 11 8 10 2 
17 6 11 1 3 
18 2 5 1 2 
19 3 1 0 —3 
20 7 5 0 —6 
21 7 10 4 4 
22 8 y —2 8 
23 4 9 3 0 
24 9 6 3 5 


Source: Data provided courtesy of B. M. Brooks, Ph.D. 


After eliminating subject effects, can we conclude that the improvement scores differ among methods 
of training? Let а = .05. 


McConville et al. (A-12) report the effects of chewing one piece of nicotine gum (containing 2 mg 
nicotine) on tic frequency in patients whose Tourette's disorder was inadequately controlled by 
haloperidol. The following are the tic frequencies under four conditions: 


Number of Tics During 30-Minute Period 


After End of Chewing 
Gum 0-30 30-60 

Patient Baseline Chewing Minutes Minutes 
1 249 108 93 59 
2 1095 593 600 861 
3 83 27 32 61 
4 569 363 342 312 
5 368 141 167 180 
6 326 134 144 158 
7 324 126 312 260 
8 95 41 63 71 
9 413 365 282 321 
10 332 293 525 455 


Source: Data provided courtesy of Brian J. McConville, M. Harold Fogelson, 
Andrew B. Norman, William M. Klykylo, Pat Z. Manderscheid, Karen W. 
Parker, and Paul R. Sanberg. “Nicotine Potentiation of Haloperidol in 
Reducing Tic Frequency in Tourette's Disorder," American Journal of 
Psychiatry, 148 (1991), 793—794. Copyright (C) 1991, American Psychiatric 
Association. 


After eliminating patient effects, can we conclude that the mean number of tics differs among the four 
conditions? Let o — .01. 


A remotivation team in a psychiatric hospital conducted an experiment to compare five methods for 
remotivating patients. Patients were grouped according to level of initial motivation. Patients in each 
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group were randomly assigned to the five methods. At the end of the experimental period the patients 
were evaluated by a team composed of a psychiatrist, a psychologist, a nurse, and a social worker, 
none of whom was aware of the method to which patients had been assigned. The team assigned each 
patient a composite score as a measure of his or her level of motivation. The results were as follows: 


Level of Initial Remotivation Method 
Motivation Е. 
А В С D E 


Nil 58 68 60 68 64 
Very low 62 70 65 80 69 
Low 67 78 68 81 70 
Average 70 81 70 89 74 


Do these data provide sufficient evidence to indicate a difference in mean scores among methods? Let 
а = .05. 


The nursing supervisor in a local health department wished to study the influence of time of day on 
length of home visits by the nursing staff. It was thought that individual differences among nurses 
might be large, so the nurse was used as a blocking factor. The nursing supervisor collected the 
following data: 


Length of Home Visit by Time of Day 


Early Late Early Late 
Nurse Morning Morning Afternoon Afternoon 
A 27 28 30 23 
B 31 30 27 20 
С 35 38 34 30 
D 20 18 20 14 


Do these data provide sufficient evidence to indicate a difference in length of home visit among the 
different times of day? Let a = .05. 


Four subjects participated in an experiment to compare three methods of relieving stress. Each 
subject was placed in a stressful situation on three different occasions. Each time a different method 
for reducing stress was used with the subject. The response variable is the amount of decrease in stress 
level as measured before and after treatment application. The results were as follows: 


¡PAINE 
Subject A B C 
1 16 26 22 
2 16 20 23 
3 17 21 22 
4 28 29 36 


Can we conclude from these data that the three methods differ in effectiveness? Let о = .05. 
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8.3.6. 


8.3.7. 


In a study by Valencia et al. (A-13), the effects of environmental temperature and humidity on 
24-hour energy expenditure were measured using whole-body indirect calorimetry in eight normal- 
weight young men who wore standardized light clothing and followed a controlled activity regimen. 
Temperature effects were assessed by measurements at 20, 23, 26, and 30 degrees Celsius at ambient 
humidity and at 20 and 30 degrees Celsius with high humidity. What is the blocking variable? The 
treatment variable? How many blocks are there? How many treatments? Construct an ANOVA table 
in which you specify the sources of variability and the degrees of freedom for each. What are the 
experimental units? What extraneous variables can you think of whose effects would be included in 
the error term? 


Hodgson et al. (A-14) conducted a study in which they induced gastric dilatation in six 
anesthetized dogs maintained with constant-dose isoflurane in oxygen. Cardiopulmonary mea- 
surements prior to stomach distension (baseline) were compared with measurements taken 
during .1, .5, 1.0, 1.5, 2.5, and 3.5 hours of stomach distension by analyzing the change from 
baseline. After distending the stomach, cardiac index increased from 1.5 to 3.5 hours. Stroke 
volume did not change. During inflation, increases were observed in systemic arterial, pulmonary 
arterial, and right atrial pressure. Respiratory frequency was unchanged. РаО» tended to decrease 
during gastric dilatation. What are the experimental units? The blocks? Treatment variable? 
Response variable(s)? Can you think of any extraneous variable whose effect would contribute to 
the error term? Construct an ANOVA table for this study in which you identify the sources of 
variability and specify the degrees of freedom. 


8.4 THE REPEATED MEASURES DESIGN 


One of the most frequently used experimental designs in the health sciences field is the 
repeated measures design. 


DEFINITION 


A repeated measures design is one in which measurements of the same 
variable are made on each subject on two or more different occasions. 


The different occasions during which measurements are taken may be either points in 
time or different conditions such as different treatments. 


When to Use Repeated Measures The usual motivation for using a 
repeated measures design is a desire to control for variability among subjects. In 
such a design each subject serves as its own control. When measurements are taken 
on only two occasions, we have the paired comparisons design that we discussed in 
Chapter 7. One of the most frequently encountered situations in which the repeated 
measures design is used is the situation in which the investigator is concerned with 
responses over time. 


Advantages The major advantage of the repeated measures design is, as previously 
mentioned, its ability to control for extraneous variation among subjects. An additional 
advantage is the fact that fewer subjects are needed for the repeated measures design than 
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for a design in which different subjects are used for each occasion on which measurements 
are made. Suppose, for example, that we have four treatments (in the usual sense) or four 
points in time on each of which we would like to have 10 measurements. If a different 
sample of subjects is used for each of the four treatments or points in time, 40 subjects 
would be required. If we are able to take measurements on the same subject for each 
treatment or point in time—that is, if we can use a repeated measures design—only 10 
subjects would be required. This can be a very attractive advantage if subjects are scarce or 
expensive to recruit. 


Disadvantages A major potential problem to be on the alert for is what is known as 
the carry-over effect. When two or more treatments are being evaluated, the investigator 
should make sure that a subject's response to one treatment does not reflect a residual effect 
from previous treatments. This problem can frequently be solved by allowing a sufficient 
length of time between treatments. 

Another possible problem is the position effect. A subject's response to a treatment 
experienced last in a sequence may be different from the response that would have occurred 
if the treatment had been first in the sequence. In certain studies, such as those involving 
physical participation on the part of the subjects, enthusiasm that is high at the beginning of 
the study may give way to boredom toward the end. A way around this problem is to 
randomize the sequence of treatments independently for each subject. 


Single-Factor Repeated Measures Design The simplest repeated mea- 
sures design is the one in which, in addition to the treatment variable, one additional 
variable is considered. The reason for introducing this additional variable is to measure and 
isolate its contribution to the total variability among the observations. We refer to this 
additional variable as a factor. 


DEFINITION 


The repeated measures design in which one additional factor is introduced 
into the experiment is called a single-factor repeated measures design. 


We refer to the additional factor as subjects. In the single-factor repeated measures 
design, each subject receives each of the treatments. The order in which the subjects are 
exposed to the treatments, when possible, is random, and the randomization is carried out 
independently for each subject. 


Assumptions The following are the assumptions of the single-factor repeated 
measures design that we consider in this text. A design in which these assumptions are met 
is called a fixed-effects additive design. 


1. The subjects under study constitute a simple random sample from a population of 
similar subjects. 


2. Each observation is an independent simple random sample of size 1 from each of kn 
populations, where n is the number of subjects and k is the number of treatments to 
which each subject is exposed. 
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3. The kn populations have potentially different means, but they all have the same 
variance. 


4. The k treatments are fixed; that is, they are the only treatments about which we have 
an interest in the current situation. We do not wish to make inferences to some larger 
collection of treatments. 


5. There is no interaction between treatments and subjects; that is, the treatment and 
subject effects are additive. 


Experimenters may find frequently that their data do not conform to the assumptions 
of fixed treatments and/or additive treatment and subject effects. For such cases the 
references at the end of this chapter may be consulted for guidance. 


In addition to the assumptions just listed, it should be noted that in a repeated- 
measures experiment there is a presumption that correlations should exist among the 
repeated measures. That is, measurements at time 1 and 2 are likely correlated, as 
are measurements at time 1 and 3, 2 and 3, and so on. This is expected because the 
measurements are taken on the same individuals through time. 

An underlying assumption of the repeated-measures ANOVA design is that all of 
these correlations are the same, a condition referred to as compound symmetry. This 
assumption, coupled with assumption 3 concerning equal variances, is referred to as 
sphericity. Violations of the sphericity assumption can result in an inflated type I error. 
Most computer programs provide a formal test for the sphericity assumption along with 
alternative estimation methods if the sphericity assumption is violated. 


The Model The model for the fixed-effects additive single-factor repeated measures 
design is 


xj = и + Bit ту + Є) 
pm1,2,...,m. Jo 12; 


(8.4.1) 


The reader will recognize this model as the model for the randomized complete block 
design discussed in Section 8.3. The subjects are the blocks. Consequently, the notation, 
data display, and hypothesis testing procedure are the same as for the randomized complete 
block design as presented earlier. The following is an example of a repeated measures 
design. 


EXAMPLE 8.4.1 


Licciardone et al. (A-15) examined subjects with chronic, nonspecific low back pain. In 
this study, 18 of the subjects completed a survey questionnaire assessing physical 
functioning at baseline, and after 1, 3, and 6 months. Table 8.4.1 shows the data for 
these subjects who received a sham treatment that appeared to be genuine osteopathic 
manipulation. Higher values indicate better physical functioning. The goal of the experi- 
ment was to determine if subjects would report improvement over time even though the 
treatment they received would provide minimal improvement. We wish to know if there is a 
difference in the mean survey values among the four points in time. 


TABLE 8.4.1 
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SF-36 Health Scores at Four Different 
Points in Time 


Subject Baseline Month 1 Month 3 Month 6 


cA SAX CASS cx 
мо стор бо кю = о о со мч ф тс » ом = 


18 


80 
95 
65 
50 
60 
70 
80 
70 
80 
65 
60 
50 
50 
85 
50 
15 
10 
80 


60 95 100 
90 95 95 
55 50 45 
45 70 70 
75 80 85 
70 75 70 
80 85 80 
60 75 65 
80 70 65 
30 45 60 
70 95 80 
50 70 60 
65 80 65 
45 85 80 
65 90 70 
30 20 25 
15 55 75 
85 90 70 


Source: Data provided courtesy of John C. Licciardone. 


Solution: 


Data. See Table 8.4.1. 


Assumptions. We assume that the assumptions for the fixed-effects, 
additive single-factor repeated measures design are met. 


Hypotheses. 


Ho: Ив = Им! = Имз = Имб 
НА: not all us are equal 


Test statistic. V.R. — treatment MS/error MS. 


Distribution of test statistic. F with 4 — 1 — 3 numerator degrees of 
freedom and 71 — 3 — 17 — 51 denominator degrees of freedom. 


Decision rule. Let о = .05. The critical value of F is 2.80 (obtained 
by interpolation). Reject Но if computed V.R. is equal to or greater 
than 2.80. 


Calculation of test statistic. We use MINITAB to perform the 
calculations. We first enter the measurements in Column 1, the row 
(subject) codes in Column 2, the treatment (time period) codes in 
Column 3, and proceed as shown in Figure 8.4.1. 
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Dialog box: Session command: 


Stat > ANOVA > Twoway MTB » TWOWAY C1 C2 C3; 
SUBC» MEANS C2 C3. 


Type СІ in Response. Type C2 in Row factor and 
Check Display means. Type C3 in Column factor and 
Check Display means. Click OK. 


Output: 


Two-way ANOVA: C1 versus C2, C3 


Analysis of Variance for C1 
Source DF SS 
C2 17 20238 
C3 3 2396 
Error 51 7404 
Total 30038 


FIGURE 8.4.1 MINITAB procedure and output (ANOVA table) for Example 8.4.1. 


8. Statistical decision. Since V.R. = 5.50 is greater than 2.80, we are able 
to reject the null hypothesis. 


9, Conclusion. We conclude that there is a difference in the four 
population means. 


10. p value. Since 5.50 is greater than 4.98, the F value for а = .005 and 
df — 40, the p value is less than .005. 


Figure 8.4.2, shows the SAS? output for the analysis of Example 8.4.1 and Figure 8.4.3 
shows the SPSS output for the same example. Note that SPSS provides four potential tests. 
The first test is used under an assumption of sphericity and matches the outputs in Figures 
8.4.1 and 8.4.2. The next three tests are modifications if the assumption of sphericity is 
violated. Note that SPSS modifies the degrees of freedom for these three tests, which 
changes the mean squares and the p values, but not the V. R. Note that the assumption of 
sphericity was violated for these data, but that the decision rule did not change, since all of 
the p values were less than о = .05. A 


Two-Factor Repeated Measures Design Repeated measures ANOVA is 
not useful just for testing means among different observation times. The analyses are easily 
expanded to include testing for differences among times for different treatment groups. As 
an example, a clinic may wish to test a placebo treatment against a new medication 
treatment. Researchers will randomly assign patients to one of the two treatment groups 
and will obtain measurements through time for each subject. In the end they are interested 


8.4 THE REPEATED MEASURES DESIGN 351 


The ANOVA Procedure 


Dependent Variable: sf36 


Source DF Sum of Squares Mean Square 


Model 20 22633.33333 1131.66667 


Error 51 7404.16667 145.17974 
Corrected Total 71 30037.50000 


R-Square Coeff Var Root MSE  sf36 Mean 


0.753503 18.18725 12.04906 66.25000 


Anova SS Mean Square F Value 


20237.50000 1190.44118 8.20 
2395.83333 798.61111 5.50 


FIGURE 8.4.2 SAS? output for analysis of Example 8.4.1. 


Tests of Within-Subjects Effects 
Measure: MEASURE 1 
Type Ш Sum Mean 
Source of Squares df Square F Sig. 
factor 1 Sphericity Assumed 2395.833 3 798.611 5.501 .002 
Greenhouse-Geisser 2395.833 2.216 1080.998 | 5.501 .006 
Huynh-Feldt 2395.833 2.563 934.701 5.501 .004 
Lower-bound 2395.833 1.000 2395.833 | 5.501 .031 
Error (factor 1) Ѕрпһегісіїу Assumed 7404.167 51 145.180 
Greenhouse-Geisser 7404.167 37.677 196.515 
Huynh-Feldt 7404.167 43.575 169.919 
Lower-bound 7404.167 17000 435.539 


FIGURE 8.4.3 SPSS output for the analysis of Example 8.4.1. 
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in knowing if there were differences between the two treatments on subjects that were 
measured multiple times. 


Assumptions The assumptions of the two-factor repeated measures design are the same 
as the single-factor repeated measures design. However, it is not uncommon for there to be 
interactions among the treatments in this design, a potential violation of Assumption 5, 
above. Interaction effects can be interesting to examine, but are complex to calculate. For 
this reason, and at the level of the intended audience using this text, we will assume that 
interaction effects, when present, are mathematically handled using a statistical software 
package that provides correct calculations for this issue. 


The Model The model for the two-factor repeated measures design must represent the 
fact that there are two factors, A and B, and they have a potential interaction. These 
features, along with the block effect and error, must be accounted for in the model, which is 
given by 

хук = U + py + oti + В, + (eB); + €i 


(8.4.2) 
i21,22,..,4 jo21L2,.,b k=1,2,... 


In this model 


Хук is a typical individual from the overall population 

и an unknown constant 

pj; represents a block effect 

ау represents the main effect of factor A 

В; represents the main effect of factor B 

(af) їх represents the interaction effect of factor A and factor В 

Єїк 18 a residual component representing all sources of variation other than treatments 
and blocks. 


This model is very similar to the two-factor ANOVA model presented in Section 8.5. 


EXAMPLE 8.4.2 


The Mid-Michigan Medical Center (A-16) examined 25 subjects with neck cancer and 
measured as one of the outcome variables an oral health condition score. Patients were 
randomly divided into two treatment groups. These were a placebo treatment (treatment 1) 
and an aloe juice group (treatment 2). Cancer health was measured at baseline and at the 
end of 2, 4, and 6 weeks of treatment. The goal was to discern if there was any change in 
oral health condition over the course of the experiment and to see if there were any 
differences between the two treatment conditions. 


Solution: 


1. Data. See Table 8.4.2. 


2. Assumptions. We assume that the assumptions for the two-factor 
repeated measures experiment are met. 
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TABLE 8.4.2 Oral Health Condition Scores at Four Different Points in Time 
Under Two Treatment Conditions 


Treatment 
1 = placebo 

Subject 2 — aloe juice TotalC1 TotalC2 TotalC3 TotalC4 

1 1 6 6 6 

2 1 9 6 10 9 

3 1 7 9 17 19 

4 1 6 7 9 3 

5 1 6 7 16 13 

6 1 6 6 6 11 

7 1 6 11 11 10 

8 1 6 11 15 15 

9 1 6 9 6 8 
10 1 6 4 8 7 
11 1 7 8 11 11 
12 1 6 6 9 6 
13 1 8 8 9 10 
14 1 7 16 9 10 
15 2 6 10 11 9 
16 2 4 6 8 7 
17 2 6 11 11 14 
18 2 6 7 6 6 
19 2 12 11 12 9 
20 2 5 7 13 12 
21 2 6 7 7 7 
22 2 8 11 16 16 
23 2 5 7 7 7 
24 2 6 8 16 16 
25 2 7 8 10 8 


Source: Mid-Michigan Medical Center, Midland, Michigan, 1999: A study of oral condition of cancer patients. 
Available in the public domain at: http://[calcnet.mth.cmich.edu/org/spss/Prj cancer data.htm. 


3. Hypotheses. 
а. Но: a; = 0 i=1,2,...,a 
На: not alla; = 0 


b. Ho: f; =0 j=1,2,...,b 
На: not all B; —0 

с. Но: (ав), = 0 i=1,2,...,a,j=1,2,...,b 
На: not all (af); = 0 
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4. 
5. 


10. 


Test statistic. The test statistic for each hypothesis set is V.R. 


Distribution of test statistics. When Но is true and the assumptions are 
met, each of the test statistics is distributed as Е If all assumptions are 
met for the within-subjects effects, we will have F with 4— 1 —3 
numerator degrees of freedom for the time factor, (4 — 1)(2 - 1) = 3 
numerator degrees of freedom for the interaction factor, and 
(4 — 1)(25 — 2) = 69 denominator degrees of freedom for both tests; 
interpolation from Table G provides a critical F value of 2.74. Further, for 
the between-subjects factor, we will have (2 — 1) — 1 numerator degrees 
of freedom and 25 — 2 — 23 denominator degrees of freedom; Table G 
gives the critical F value to be 4.28. If we do not meet the assumptions, 
specifically of sphericity, then the computer program will alter the degrees 
of freedom and hence the critical value for comparisons. 


Decision rule. Let о = .05. Reject Но if the computed p value is less 
than o. 


Calculation of test statistic. We use SPSS to perform the calculations. 
We enter the data just as it is shown in Table 8.4.2, though we do not 
need to enter the "Subject" number. The SPSS code and pertinent output 
are shown in Figure 8.4.4. 


Statistical decision. SPSS provides a formal test for sphericity called 
“Mauchley’s Test of Sphericity”. Since we reject the null for this test 
according to the output in Figure 8.4.2, we will use the “Greenhouse- 
Geisser" test statistic. Since V.R. is greater than the critical value for 
TotalC, we reject the null hypothesis for this variable. However, both the 
critical values for the interaction effect and the between-subjects factor 
are quite small and less than the necessary critical value, and we 
therefore fail to reject these two null hypotheses. 


Conclusion. We conclude that there is no statistical difference between 
treatments, but that subjects did have a change in oral condition through 
time regardless of the treatment they received. 


p value. As seen in Figure 8.4.4, all p values are provided for each test. 
To summarize: since p « .001, we reject the null hypothesis concerning 
changes through time. Since p — .931, we fail to reject the null 
hypothesis concerning the interaction of time and treatment. Since 
р = .815, we fail to reject the null hypothesis concerning differences 
between treatments. 


Though the output provided in Figure 8.4.2 can be valuable for statistical interpretation, it 
is often useful to examine plots to obtain a visual interpretation of the results. Figure 8.4.5 
shows a plot of marginal means against time, with lines representing each of the treatments. 
It is evident that changes in oral condition did occur through time, but that the two 
treatments were very similar, as can be seen by the close proximity of the two curves. 
Further, it is evident that interaction between time and treatment occurred, as evidenced by 
the crossing of the plotted lines. и 
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SPSS Code 

GLM TOTALCIN TOTALCW2 TOTALCW4 TOTALCW6 BY TRT 
/WSFACTOR=TotatC 4 Polynomial 
/METHOD=SSTYPE(3) 
/PLOT=PROFILE(TRT+TotalCTot31C*TRT) 
/EMMEANS=TABLES(TRT) 
/EMMEANS-TABLES(TotalC) 
/EMMEANS=TABLES(TRTTotalC) 
/PR!NT=DESCRIPTIVE 
/CRITERIA=ALPHA(.O5) 
/WSDESIGN=TotalC 

/DESIGN=TRT. 


Partial SPSS Outout 
Mauchly’s Test of Sphericity" 


Within Subjects Effect 
TotalC 


Mauchly's W 
.487 


Approx. Chi-Square 
15.620 


Tests of Within-Subjects Effects 


Type 111 Sum 


Source of Squares Mean Square 


TotalC 233.391 
233.391 
233.391 


233.391 


77.797 
115.261 
100.682 
233.391 


Sphericity Assumed 
Greenhouse-Geisser 
Huynh-Feldt 
Lower-bound 


TotalC * TRT 1.231 
1.231 
1.231 


1.231 


410 
.608 
531 
1.231 


Sphericity Assumed 
Greenhouse-Geisser 
Huynh-Feldt 
Lower-bound 


Error(TotalC) 385.469 
385.469 
385.469 


385.469 


5.587 
8.277 
7.230 
16.760 


Sphericity Assumed 
Greenhouse-Geisser 
Huynh-Feldt 
Lower-bound 


Tests of Between-Subjects Effects 


Type III Sum 


Source 


of Squares 


Mean Square 


F 


Intercept 
TRT 


Error 


FIGURE 8.4.4 SPSS code and partial output for Example 8.4.2. 


7637.274 
1.114 
459.226 


7637.274 
1.114 
19.966 


382.508 
056 
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FIGURE 8.4.5 Excel plot of marginal means against total oral health score for the data of 
Example 8.4.2. 


EXERCISES 


8.4.1. 


8.4.2. 


For Exercises 8.4.1 to 8.4.3 perform the ten-step hypothesis testing procedure. Let o — .05. 


One of the purposes of a study by Liu et al. (A-17) was to determine the effects of MRZ 2/579 on 
neurological deficit in Sprague-Dawley rats. In this study, 10 rats were measured at four time periods 
following occlusion of the middle carotid artery and subsequent treatment with the uncompetitive N- 
methly-D-aspartate antagonist MRZ 2/579, which previous studies had suggested provides neuro- 
protective activity. The outcome variable was a neurological function variable measured on a scale of 
0-12. A higher number indicates a higher degree of neurological impairment. 


Rat 60 Minutes 24 Hours 48 Hours 72 Hours 
1 11 9 8 4 
2 11 7 5 3 
3 11 10 8 6 
4 11 4 3 2 
5 11 10 9 9 
6 11 6 5 5 
7 11 6 6 6 
8 11 7 6 5 
9 11 7 5 5 

10 11 9 7 7 


Source: Data provided courtesy of Ludmila Belayev, M.D. 


Starch et al. (A-18) wanted to show the effectiveness of a central four-quadrant sleeve and screw in 
anterior cruciate ligament reconstruction. The researchers performed a series of reconstructions on 
eight cadaveric knees. The following table shows the loads (in newtons) required to achieve different 
graft laxities (mm) for seven specimens (data not available for one specimen) using five different load 
weights. Graft laxity is the separation (in mm) of the femur and the tibia at the points of graft fixation. 


8.4.3. 


8.4.4. 


8.4.5. 
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Is there sufficient evidence to conclude that different loads are required to produce different levels of 
graft laxity? Let о = .05. 


Graft Laxity (mm) 

Specimen 1 2 3 4 5 

1 297.1 297.1 297.1 297.1 297.1 
2 264.4 304.6 336.4 358.2 379.3 
3 188.8 188.8 188.8 188.8 188.8 
4 159.3 194.7 211.4 222.4 228.1 
5 228.2 282.1 282.1 334.8 334.8 
6 100.3 105.0 106.3 107.7 108.7 
7 116.9 140.6 182.4 209.7 215.4 


Source: David W. Starch, Jerry W. Alexander, Philip C. Noble, Suraj Reddy, and David M. 
Lintner, “Multistranded Hamstring Tendon Graft Fixation with a Central Four-Quadrant 

or a Standard Tibial Interference Screw for Anterior Cruciate Ligament Reconstruction,” 
American Journal of Sports Medicine, 31 (2003), 338-344. 


Holben et al. (A-19) designed a study to evaluate selenium intake in young women in the years of 
puberty. The researchers studied a cohort of 16 women for three consecutive summers. One of the 
outcome variables was the selenium intake per day. The researchers examined dietary journals of 
the subjects over the course of 2 weeks and then computed the average daily selenium intake. The 
following table shows the average daily selenium intake values (in wg/d) for the 16 women in years 
1, 2, and 3 of the study. 


Subject Year 1 Year 2 Year 3 Subject Year 1 Year 2 Year 3 
1 112.51 121.28 94.99 9 95.05 93.89 73.26 
2 106.20 121.14 145.69 10 112.65 100.47 145.69 
3 102.00 121.14 130.37 11 103.74 121.14 123.97 
4 103.74 90.21 135.91 12 103.74 121.14 135.91 
5 103.17 121.14 145.69 13 112.67 104.66 136.87 
6 112.65 98.11 145.69 14 106.20 121.14 126.42 
7 106.20 121.14 136.43 15 103.74 121.14 136.43 
8 83.57 102.87 144.35 16 106.20 100.47 135.91 


Source: Data provided courtesy of David H. Holben, Ph.D. and John P. Holcomb, Ph.D. 


Linke et al. (A-20) studied seven male mongrel dogs. They induced diabetes by injecting the animals 
with alloxan monohydrate. The researchers measured the arterial glucose (mg/gl), arterial lactate 
(mmol/L), arterial free fatty acid concentration, and arterial 8-hydroxybutyric acid concentration 
prior to the alloxan injection, and again in weeks 1, 2, 3, and 4 post-injection. What is the response 
variable(s)? Comment on carryover effect and position effect as they may or may not be of concern in 
this study. Construct an ANOVA table for this study in which you identify the sources of variability 
and specify the degrees of freedom for each. 


Werther et al. (A-21) examined the vascular endothelial growth factor (VEGF) concentration in blood 
from colon cancer patients. Research suggests that inhibiting VEGF may disrupt tumor growth. The 
researchers measured VEGF concentration (ng/L) for 10 subjects and found an upward trend in 
VEGF concentrations during the clotting time measured at baseline, and hours 1 and 2. What is the 
response variable? What is the treatment variable? Construct an ANOVA table for this study in which 
you identify the sources of variability and specify the degrees of freedom for each. 
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8.4.6. Yucha et al. (A-22) conducted a study to determine if nursing students who were assigned to a home 


hospital (HH) experience differed from those traditionally placed (TP) in hospitals throughout their 
nursing training. A small subset of data is provided in the table below. In this data set, hospital 
placement is the between-subjects variable. Anxiety, as measured by Spielberger's State Anxiety 
Scale (where higher scores suggest higher levels of anxiety), is the within-subjects variable and is 
provided at four points in time during nursing training. Is there evidence that anxiety level changed 
through time for these nursing students? Is there a difference in anxiety between those in a home 
hospital placement versus traditional placement? Is there significant interaction between placement 
type and anxiety? Let о = .05. 


Subject Hospital Placement Anxiety 1 Anxiety 2 Anxiety 3 Anxiety 4 


1 HH 51 33 12 31 
2 HH 50 51 50 44 
3 HH 65 58 45 37 
4 HH 43 40 3l 51 
5 HH 67 56 50 42 
6 HH 46 69 62 46 
7 HH 29 28 28 43 
8 HH 76 69 62 60 
9 HH 66 39 47 38 
10 HH 56 46 34 31 
11 TP 44 48 51 59 
12 ТР 44 50 54 40 
13 ТР 54 49 35 46 
14 ТР 38 38 32 37 
15 ТР 25 27 25 24 
16 ТР 61 60 55 66 
17 ТР 42 51 42 34 
18 ТР 36 49 49 51 
19 ТР 52 63 50 64 
20 ТР 41 55 56 34 


Source: Data provided Courtesy of Carolyn B. Yucha, RN, PhD, FAAN. 


8.5 THEFACTORIAL EXPERIMENT 


In the experimental designs that we have considered up to this point, we have been 
interested in the effects of only one variable—the treatments. Frequently, however, we may 
be interested in studying, simultaneously, the effects of two or more variables. We refer to 
the variables in which we are interested as factors. The experiment in which two or more 
factors are investigated simultaneously is called a factorial experiment. 

The different designated categories of the factors are called levels. Suppose, for 
example, that we are studying the effect on reaction time of three dosages of some drug. 
The drug factor, then, is said to occur at three levels. Suppose the second factor of interest in 
the study is age, and it is thought that two age groups, under 65 years and 65 years and 
older, should be included. We then have two levels of the age factor. In general, we say that 
factor A occurs at a levels and factor B occurs at b levels. 
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In a factorial experiment we may study not only the effects of individual factors but 
also, if the experiment is properly conducted, the interaction between factors. To illustrate 
the concept of interaction let us consider the following example. 


EXAMPLE 8.5.1 


Suppose, in terms of effect on reaction time, that the true relationship between three dosage 
levels of some drug and the age of human subjects taking the drug is known. Suppose 
further that age occurs at two levels—" young" (under 65) and “old” (65 and older). If the 
true relationship between the two factors is known, we will know, for the three dosage 
levels, the mean effect on reaction time of subjects in the two age groups. Let us assume 
that effect is measured in terms of reduction in reaction time to some stimulus. Suppose 
these means are as shown in Table 8.5.1. 
The following important features of the data in Table 8.5.1 should be noted. 


1. For both levels of factor A the difference between the means for any two levels of 
factor B is the same. That is, for both levels of factor A, the difference between means 
for levels 1 and 2 is 5, for levels 2 and 3 the difference is 10, and for levels 1 and 3 the 
difference is 15. 


2. Foralllevels of factor B the difference between means for the two levels of factor A is 
the same. In the present case the difference is 5 at all three levels of factor B. 


3. Athird characteristic is revealed when the data are plotted as in Figure 8.5.1. We note 
that the curves corresponding to the different levels of a factor are all parallel. 


When population data possess the three characteristics listed above, we say that there is no 
interaction present. 


TABLE 8.5.1 Mean Reduction in Reaction Time 
(milliseconds) of Subjects in Two Age Groups at 
Three Drug Dosage Levels 


Factor B—Drug Dosage 


Factor A—Age j=1 j=2 j=3 
Young (i = 1) ит = 5 ил2 = 10 илз = 20 


Old (i = 2) иол = 10 A22 = 15 из = 25 


30 — Drug dosage 
25 [- а 
20 = a 


N N 
о л 
Т Т 


gl 
Т 


Reduction in reaction time 
zi) ша 
о o 
| | 
Reduction in reaction time 
$ ox 
Об 
Т Т 
= = 
= N 


0 | | | 
by bo b3 


Drug dosage Age 


o 


FIGURE 8.5.1 Age and drug effects, no interaction present. 
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TABLE 8.5.2 Data of Table 8.5.1 Altered to Show 
the Effect of One Type of Interaction 


Factor B—Drug Dosage 


Factor A—Age j=1 j=2 j=3 
Young (i = 1) Hy = 5 12 = 10 илз = 20 
Old (i = 2) A31 = 15 A22 = 10 из = 5 
Ф Ф 
Е sor Е sor 
A 

5 25 di S25r 
E 20 ал E 201 Drug dosage 
2 2 b 
E 15 - E 15 [- 1 
с 10 с 10r- ba 
2 2 
5 5r a2 © 5r b3 
зо | | | зо | | 
£ bi ba b3 г a а 

Drug dosage Age 


FIGURE 8.5.2 Age and drug effects, interaction present. 


The presence of interaction between two factors can affect the characteristics of the 
data in a variety of ways depending on the nature of the interaction. We illustrate the effect 
of one type of interaction by altering the data of Table 8.5.1 as shown in Table 8.5.2. 

The important characteristics of the data in Table 8.5.2 are as follows. 


1. The difference between means for any two levels of factor B is not the same for both 
levels of factor A. We note in Table 8.5.2. for example, that the difference between 
levels 1 and 2 of factor B is —5 for the young age group and +5 for the old age group. 


2. The difference between means for both levels of factor A is not the same at all levels 
of factor B. The differences between factor A means are —10, 0, and 15 for levels 1, 2, 
and 3, respectively, of factor B. 


3. The factor level curves are not parallel, as shown in Figure 8.5.2. 
When population data exhibit the characteristics illustrated in Table 8.5.2 and 
Figure 8.5.2, we say that there is interaction between the two factors. We emphasize 


that the kind of interaction illustrated by the present example is only one of many types of 
interaction that may occur between two factors. и 


In summary, then, we can say that there is interaction between two factors if a change 
in one of the factors produces a change in response at one level of the other factor different 
from that produced at other levels of this factor. 


Advantages The advantages of the factorial experiment include the following. 


1. The interaction of the factors may be studied. 


2. There is a saving of time and effort. 
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In the factorial experiment all the observations may be used to study the effects of 
each of the factors under investigation. The alternative, when two factors are being 
investigated, would be to conduct two different experiments, one to study each of the two 
factors. If this were done, some of the observations would yield information only on one of 
the factors, and the remainder would yield information only on the other factor. To achieve 
the level of accuracy of the factorial experiment, more experimental units would be needed 
if the factors were studied through two experiments. It is seen, then, that 1 two-factor 
experiment is more economical than 2 one-factor experiments. 


3. Because the various factors are combined in one experiment, the results have a wider 
range of application. 


The Two-Factor Completely Randomized Design A factorial 
arrangement may be studied with either of the designs that have been discussed. We 
illustrate the analysis of a factorial experiment by means of a two-factor completely 
randomized design. 


1. Data. The results from a two-factor completely randomized design may be presented 
in tabular form as shown in Table 8.5.3. 

Here we have a levels of factor A, b levels of factor B, and n observations for 
each combination of levels. Each of the ab combinations of levels of factor A with 
levels of factor B is a treatment. In addition to the totals and means shown in Table 
8.5.3, we note that the total and mean of the ijth cell are 


n 
Т. = > Xijk and Xij. = T jj. /n 
k=1 


TABLE 8.5.3 Table of Sample Data from a Two-Factor 
Completely Randomized Experiment 


Factor B 
Factor A 1 2 sni b Totals Means 
1 Xm X121 d X1b1 
: Та. Xa.. 
X11n X12n X1bn 
2 X21 X221 X2b1 
: T2. X2.. 
X21n X22n X2bn 
a Хат Xa21 Xab1 
: Та. Ха 
Хатп Xa2n Xabn 
Totals Ta Toa DM T p. T. 


Means Xa. X2. Mad X b. X.. 
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respectively. The subscript i runs from 1 to a andj runs from 1 to b. The total number 
of observations is nab. 

To show that Table 8.5.3 represents data from a completely randomized design, 
we consider that each combination of factor levels is a treatment and that we have n 
observations for each treatment. An alternative arrangement of the data would be 
obtained by listing the observations of each treatment in a separate column. Table 
8.5.3 may also be used to display data from a two-factor randomized block design if 
we consider the first observation in each cell as belonging to block 1, the second 
observation in each cell as belonging to block 2, and so on to the nth observation in 
each cell, which may be considered as belonging to block n. 

Note the similarity of the data display for the factorial experiment as shown in 
Table 8.5.3 to the randomized complete block data display of Table 8.3.1. The 
factorial experiment, in order that the experimenter may test for interaction, requires 
at least two observations per cell, whereas the randomized complete block design 
requires only one observation per cell. We use two-way analysis of variance to 
analyze the data from a factorial experiment of the type presented here. 


2. Assumptions. We assume a fixed-effects model and a two-factor completely 
randomized design. For a discussion of other designs, consult the references at 
the end of this chapter. 


The Model Тһе fixed-effects model for the two-factor completely randomized 
design may be written as 


хіх = u eti + В+ (08); + єк 
1—]1,2;::::,0; уж 12.2545; AS 2 


(8.5.1) 


where худ is a typical observation, u is a constant, œ; represents an effect due to factor A, B; 
represents an effect due to factor B, (e); represents an effect due to the interaction of 
factors A and B, and єї; represents the experimental error. 


Assumptions of the Model 


a. The observations in each of the ab cells constitute a random independent sample of 
size n drawn from the population defined by the particular combination of the levels 
of the two factors. 


b. Each of the ab populations is normally distributed. 


c. The populations all have the same variance. 


3. Hypotheses. The following hypotheses may be tested: 


a. Ho: a; = 0 P= T2565 250 
На: notall a; = 0 
b. Ho: В; =0 j=1,2,...,b 
Ha: not all 8; = 0 
c. Ho: (a); = 0 17152,5547] 21052, 4b 


На: not all (08); = 0 
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Before collecting data, the researchers may decide to test only one of the possible 
hypotheses. In this case they select the hypothesis they wish to test, choose a significance 
level о, and proceed in the familiar, straightforward fashion. This procedure is free of the 
complications that arise if the researchers wish to test all three hypotheses. 

When all three hypotheses are tested, the situation is complicated by the fact that the 
three tests are not independent in the probabilistic sense. If we let a be the significance level 
associated with the test as a whole, and а", а", and а” the significance levels associated 
with hypotheses 1, 2, and 3, respectively, we find 


o «1—(1—o)(1—o^)(1-— o") (8.5.2) 


If o/ = o" = o"— .05, then a < 1 (.95)3, or а < .143. This means that the 
probability of rejecting one or more of the three hypotheses is less than .143 when a 
significance level of .05 has been chosen for the hypotheses and all are true. To demonstrate 
the hypothesis testing procedure for each case, we perform all three tests. The reader, 
however, should be aware of the problem involved in interpreting the results. 


4. Test statistic. The test statistic for each hypothesis set is V.R. 


5. Distribution of test statistic. When Но is true and the assumptions are met, each of 
the test statistics is distributed as А. 


6. Decision rule. Reject Но if the computed value of the test statistic is equal to or 
greater than the critical value of F. 

7. Calculation of test statistic. By an adaptation of the procedure used in partitioning 
the total sum of squares for the completely randomized design, it can be shown that 
the total sum of squares under the present model can be partitioned into two parts as 


follows: 
a b n a b n 7 а b n 
У? (ми х.) = — (жу x.) + x (ми — ху) 
i=l j=l k=1 i=l j=1 k=1 i=l j=1 k=1 
(8.5.3) 
or 
SST = SSTr + SSE (8.5.4) 


The sum of squares for treatments can be partitioned into three parts as follows: 


DDD —х) = а —х_)? 


i=l j=l k=l i-l j=l k=l 


DT (к; 1.) (8.5.5) 
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TABLE 8.5.4 Analysis of Variance Table for a Two-Factor Completely 
Randomized Experiment (Fixed-Effects Model) 


Source SS d.f. MS V.R. 
A SSA a-1 MSA = SSA/(a — 1) MSA/MSE 
B SSB b-1 MSB = SSBJ/(b – 1) MSB/MSE 
AB SSAB (а – 1)(b — 1) MSAB = SSAB/(a — 1)(b — 1) MSAB/MSE 
Treatments SSTr ab—1 
Residual SSE ab(n – 1) MSE = SSE/ab(n — 1) 
Total SST abn-1 

Or 


SSTr — SSA + SSB + SSAB 


The ANOVA Table Тһе results of the calculations for the fixed-effects model for a 
two-factor completely randomized experiment may, in general, be displayed as shown in 
Table 8.5.4. 


8. Statistical decision. If the assumptions stated earlier hold true, and if each 
hypothesis is true, it can be shown that each of the variance ratios shown in 
Table 8.5.4 follows an F distribution with the indicated degrees of freedom. We 
reject Ho if the computed V.R. values are equal to or greater than the 
corresponding critical values as determined by the degrees of freedom and 
the chosen significance levels. 

9. Conclusion. If we reject Ho, we conclude that Ha is true. If we fail to reject Ho, we 
conclude that Но may be true. 


10. p value. 


EXAMPLE 8.5.2 


In a study of length of time spent on individual home visits by public health nurses, data 
were reported on length of home visit, in minutes, by a sample of 80 nurses. A record was 
made also of each nurse's age and the type of illness of each patient visited. The researchers 
wished to obtain from their investigation answers to the following questions: 
1. Does the mean length of home visit differ among different age groups of nurses? 
2. Does the type of patient affect the mean length of home visit? 


3. Is there interaction between nurse's age and type of patient? 


Solution: 


1. Data. The data on length of home visit that were obtained during the 
study are shown in Table 8.5.5. 
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TABLE 8.5.5 Length of Home Visit in Minutes by Public Health Nurses by 
Nurse's Age Group and Type of Patient 


Factor B (Nurse's Age Group) Levels 


Factor A 
(Type of Patient) 1 2 3 4 
Levels (20 to 29) (30 to 39) (40 to 49) (50 and Over) 
1 (Cardiac) 20 25 24 28 
25 30 28 31 
22 29 24 26 
27 28 25 29 
21 30 30 32 
2 (Cancer) 30 30 39 40 
45 29 42 45 
30 31 36 50 
35 30 42 45 
36 30 40 60 
3 (C.V.A.) 31 32 41 42 
30 35 45 50 
40 30 40 40 
35 40 40 55 
30 30 35 45 
4 (Tuberculosis) 20 23 24 29 
21 25 25 30 
20 28 30 28 
20 30 26 27 
19 31 23 30 


2. Assumptions. To analyze these data, we assume a fixed-effects model 
and a two-factor completely randomized design. 

3. Hypotheses. For our illustrative example we may test the following 
hypotheses subject to the conditions mentioned above. 


a. Нуар = 42 = оз =  - 0 На: not all а; = 0 

b. Но: В, = Bo = Вз = В, = 0 Ha: not all В; = 0 

с. Ho: all (мВ), = 0 На: not all (ag); = 0 
Let а = .05 


4. Test statistic. The test statistic for each hypothesis set is V.R. 


5. Distribution of test statistic. When Hy is true and the assumptions are 
met, each of the test statistics is distributed as Е 
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6. 


Decision rule. Reject H if the computed value of the test statistic is 
equal to or greater than the critical value of Е The critical values of F for 
testing the three hypotheses of our illustrative example are 2.76, 2.76, 
and 2.04, respectively. Since denominator degrees of freedom equal to 
64 are not shown in Appendix Table G, 60 was used as the denominator 
degrees of freedom. 


Calculation of test statistic. We use MINITAB to perform the 
calculations. We put the measurements in Column 1, the row (factor 
A) codes in Column 2, and the column (factor B) codes in Column 3. The 
resulting column contents are shown in Table 8.5.6 . The MINITAB 
output is shown in Figure 8.5.3. 


TABLE 8.5.6 Column Contents for MINITAB Calculations, 
Example 8.5.2 


Row C1 c2 c3 Row C1 c2 Сз 
1 20 1 1 41 31 3 1 
2 25 1 1 42 30 3 1 
3 22 1 1 43 40 3 1 
4 27 1 1 44 35 3 1 
5 21 1 1 45 30 3 1 
6 25 1 2 46 32 3 2 
7 30 1 2 47 35 3 2 
8 29 1 2 48 30 3 2 
9 28 1 2 49 40 3 2 

10 30 1 2 50 30 3 2 

11 24 1 3 51 41 3 3 

12 28 1 3 52 45 3 3 

13 24 1 3 53 40 3 3 

14 25 1 3 54 40 3 3 

15 30 1 3 55 35 3 3 

16 28 1 4 56 42 3 4 

17 31 1 4 57 50 3 4 

18 26 1 4 58 40 3 4 

19 29 1 4 59 55 3 4 

20 32 1 4 60 45 3 4 

21 30 2 1 61 20 4 1 

22 45 2 1 62 21 4 1 

23 30 2 1 63 20 4 1 

24 35 2 1 64 20 4 1 

25 36 2 1 65 19 4 1 

26 30 2 2 66 23 4 2 

27 29 2 2 67 25 4 2 

28 31 2 2 68 28 4 2 


(Continued) 
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Row C1 C2 Сз Row C1 C2 Сз 
29 30 2 2 69 30 4 2 
30 30 2 2 70 31 4 2 
31 39 2 3 71 24 4 3 
32 42 2 3 72 25 4 3 
33 36 2 3 73 30 4 3 
34 42 2 3 74 26 4 3 
35 40 2 3 75 23 4 3 
36 40 2 4 76 29 4 4 
37 45 2 4 77 30 4 4 
38 50 2 4 78 28 4 4 
39 45 2 4 79 27 4 4 
40 60 2 4 80 30 4 4 
8. Statistical decision. The variance ratios are У.К. (А) = 997.5/ 
14.7 = 67.86, У.В. (В) = 400.4/14.7 = 27.24, and V.R.(AB) = 
67.6/ 14.7 = 4.60. Since the three computed values of VR. are all 
greater than the corresponding critical values, we reject all three null 
hypotheses. 

. Conclusion. When Но: а; = a2 = оз = ад is rejected, we conclude 
that there are differences among the levels of A, that is, differences in the 
average amount of time spent in home visits with different types of 
patients. Similarly, when Ho: В = f»; = В; = Ba is rejected, we con- 
clude that there are differences among the levels of B, or differences in 
the average amount of time spent on home visits among the different 
nurses when grouped by age. When Ho: (ab); = 0 is rejected, we 
conclude that factors A and B interact; that is, different combinations 
of levels of the two factors produce different effects. 

10. p value. Since 67.86, 27.24, and 4.60 are all greater than the critical 
values of F 995 for the appropriate degrees of freedom, the p value for 
each of the tests is less than .005. When the hypothesis of no interaction 
is rejected, interest in the levels of factors A and B usually become 
subordinate to interest in the interaction effects. In other words, we are 
more interested in learning what combinations of levels are significantly 
different. 

Figure 8.5.4 shows the SAS® output for the analysis of Example 8.5.2. A 


We have treated only the case where the number of observations in each cell is the same. 
When the number of observations per cell is not the same for every cell, the analysis 
becomes more complex. 


In such cases the design is said to be unbalanced. To analyze these designs with 


MINITAB we use the general linear (GLM) procedure. Other software packages such as 
SAS? also will accommodate unequal cell sizes. 
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Dialog box: Session command: 


Stat » ANOVA » Twoway В > TWOWAY Cl C2 C3; 
BC » MEANS C2 C3. 


Type СІ in Response. Type C2 in Row factor and 
check Display means. Type C3 in Column factor and 
check Display means. Click OK. 


Output: 


Two-Way ANOVA: C1 versus C2, C3 


Analysis of Variance for C1 
Source DF SS 
C2 2992. 

СЗ 1201. 
Interaction 608. 
Error 939. 
Total 5741. 


Individual 95$ CI 


+ 
28.00 


Individual 95% 


------ +---------+---------+---------+---—- 
31.250 35.00 


FIGURE 8.5.3 MINITAB procedure and ANOVA table for Example 8.5.2. 
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The SAS System 


Analysis of Variance Procedure 


Dependent Variable: TIME 


Source 


Model 


Error 


DF Sum of Squares Mean Square 


15 4801.95000000 320.13000000 


64 939.60000000 14.68125000 


Corrected Total 79 5741.55000000 


Source 


FACTORB 
FACTORA 


R-Square GM. Root MSE TIME Mean 


0.836351 11.90866 3.83161193 32.17500000 


DF Anova SS Mean Square Pr > F 


1201.05000000 400.35000000 0.0001 
2992.45000000 997.48333333 0.0001 


FACTORB*FACTORA 608.450000000 67.60555556 0.0001 


FIGURE 8.5.4 SAS? output for analysis of Example 8.5.2. 


EXERCISES 


8.5.1. 


For Exercises 8.5.1 to 8.5.4, perform the analysis of variance, test appropriate hypotheses at the 
.05 level of significance, and determine the p value associated with each test. 


Uryu et al. (A-23) studied the effect of three different doses of troglitazone (uM) on neuro cell death. 
Cell death caused by stroke partially results from the accumulation of high concentrations of 
glutamate. The researchers wanted to determine if different doses of troglitazone (1.3, 4.5, and 
13.5 uM) and different ion forms (— and +) of LY294002, a PI3-kinase inhibitor, would give 
different levels of neuroprotection. Four rats were studied at each dose and ion level, and the mea- 
sured variable is the percent of cell death as compared to glutamate. Therefore, a higher value implies 
less neuroprotection. The results are displayed in the table below. 


Percent Compared Troglitazone 
to Glutamate —LY294002 vs + LY294002 Dose (и M) 
73.61 Negative 1.3 
130.69 Negative 1.3 
118.01 Negative 1.3 
140.20 Negative 1.3 


(Continued) 
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8.5.2. 


Percent Compared Troglitazone 
to Glutamate —LY294002 vs + LY294002 Dose (uM) 

97.11 Positive 1.3 
114.26 Positive 1.3 
120.26 Positive 1.3 
92.39 Positive 1.3 
26.95 Negative 4.5 
53.23 Negative 4.5 
59.57 Negative 4.5 
53.23 Negative 4.5 
28.51 Positive 4.5 
30.65 Positive 4.5 
44.37 Positive 4.5 
36.23 Positive 4.5 
—8.83 Negative 13.5 
25.14 Negative 13.5 
20.16 Negative 13.5 
34.65 Negative 13.5 
— 35.80 Positive 13.5 
—7.93 Positive 13.5 
— 19.08 Positive 13.5 
5.36 Positive 13.5 


Source: Data provided courtesy of Shigeko Uryu. 


Researchers at a trauma center wished to develop a program to help brain-damaged trauma victims 
regain an acceptable level of independence. An experiment involving 72 subjects with the same 
degree of brain damage was conducted. The objective was to compare different combinations of 
psychiatric treatment and physical therapy. Each subject was assigned to one of 24 different 
combinations of four types of psychiatric treatment and six physical therapy programs. There 
were three subjects in each combination. The response variable is the number of months elapsing 
between initiation of therapy and time at which the patient was able to function independently. The 
results were as follows: 


Physical Psychiatric Treatment 

Therapy Program A B C D 
11.0 9.4 12.5 13.2 

I 9.6 9.6 11.5 13.2 
10.8 9.6 10.5 13.5 
10.5 10.8 10.5 15.0 

II 11.5 10.5 11.8 14.6 
12.0 10.5 11.5 14.0 
12.0 11.5 11.8 12.8 

Ш 11.5 11.5 11.8 13.7 
11.8 12.3 12.3 13.1 
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Physical Psychiatric Treatment 

Therapy Program A B C D 
11.5 9.4 13.7 14.0 

IV 11.8 9.1 13.5 15.0 
10.5 10.8 12.5 14.0 
11.0 11.2 14.4 13.0 

V 11.2 11.8 14.2 14.2 
10.0 10.2 13.5 13.7 
11.2 10.8 11.5 11.8 

VI 10.8 11.5 10.2 12.8 
11.8 10.2 11.5 12.0 


Can one conclude on the basis of these data that the different psychiatric treatment programs have 
different effects? Can one conclude that the physical therapy programs differ in effectiveness? Can 
one conclude that there is interaction between psychiatric treatment programs and physical therapy 
programs? Let o = .05 for each test. 


Exercises 8.5.3 and 8.5.4 are optional since they have unequal cell sizes. It is recommended that 
the data for these be analyzed using SAS? or some other software package that will accept unequal 
cell sizes. 


8.5.3. Main et al. (A-24) state, "Primary headache is a very common condition and one that nurses 
encounter in many different care settings. Yet, there is a lack of evidence as to whether advice 
given to sufferers is effective and what improvements may be expected in the conditions." The 
researchers assessed frequency of headaches at the beginning and end of the study for 19 
subjects in an intervention group (treatment 1) and 25 subjects in a control group (treatment 2). 
Subjects in the intervention group received health education from a nurse, while the control 
group did not receive education. In the 6 months between pre- and post-evaluation, the subjects 
kept a headache diary. The following table gives as the response variable the difference (pre — 
post) in frequency of headaches over the 6 months for two factors: (1) treatment with two levels 
(intervention and control) and (2) migraine status with two levels (migraine sufferer and 
nonmigraine sufferer). 


Change in Change in 
Frequency of Migraine Sufferer Frequency of Migraine Sufferer 
Headaches (1 = Мо, 2 = Yes) Treatment Headaches (1 = No, 2 = Yes) Treatment 
-2 1 1 -3 2 2 
2 2 1 -6 2 2 
33 1 1 11 1 2 
-6 2 1 64 1 2 
6 2 1 65 1 2 
98 1 1 14 il 2 
2 2 1 8 1 2 
6 2 1 6 2 2 
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Change in Change in 
Frequency of Migraine Sufferer Frequency of Migraine Sufferer 
Headaches (1 = No, 2 - Yes) Treatment Headaches (1 = Мо, 2 = Yes) Treatment 
33 1 1 14 1 2 
—7 2 1 —11 2 2 
—1 2 1 53 1 2 
—12 2 1 26 2 2 
12 1 1 3 1 2 
64 1 1 15 1 2 
36 2 1 3 1 2 
6 2 1 41 1 2 
4 2 1 16 1 2 
11 2 1 -4 2 2 
0 2 1 -6 2 2 
9 1 2 
9 2 2 
-3 2 2 
9 2 2 
3 1 2 
4 2 2 


Source: Data provided courtesy of A. Main, Н. Abu-Saad, В. Salt, І. Vlachonikolis, and A. Dowson, "Management by Nurses of Primary 
Headache: A Pilot Study," Current Medical Research Opinion, 18 (2002), 471-478. 


8.5.4. 


Can one conclude on the basis of these data that there is a difference in the reduction of 
headache frequency between the control and treatment groups? Can one conclude that there is a 
difference in the reduction of headache frequency between migraine and non-migraine sufferers? 
Can one conclude that there is interaction between treatments and migraine status? Let o — .05 
for each test. 


The purpose of a study by Porcellini et al. (A-25) was to study the difference in CD4 cell response in 
patients taking highly active antiretroviral therapy (HAART, treatment 1) and patients taking 
HAART plus intermittent interleukin (IL-2, treatment 2). Another factor of interest was the HIV- 
RNA plasma count at baseline of study. Subjects were classified as having fewer than 50 copies/ml 
(plasma 1) or having 50 or more copies/ml (plasma 2). The outcome variable is the percent change in 
CD4 T cell count from baseline to 12 months of treatment. Can one conclude that there is a difference 
in the percent change in CD4 T cell count between the two treatments? The results are shown in the 
following table. Can one conclude that there is a difference in the percent change in CD4 T cell count 
between those who have fewer than 50/ml plasma copies of HIV-RNA and those who do not? Can one 
conclude that there is interaction between treatments and plasma levels? Let o = .05 for each test. 


Percent Change in CD4 T Cell Treatment Plasma 

—12.60 1 1 

—14.60 2. 1 
28.10 2 1 


(Continued) 


8.6 SUMMARY 373 


Percent Change in CD4 T Cell Treatment Plasma 


77.30 
—0.44 
50.20 
48.60 
86.20 
205.80 
100.00 
34.30 
82.40 
118.30 


- a A не a КО NR meme 
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Source: Data provided courtesy of Simona Porcellini, Guiliana Vallanti, 
Silvia Nozza, Guido Poli, Adriano Lazzarin, Guiseppe Tabussi, 

and Antonio Grassia, “Improved Thymopoietic Potential in Aviremic 
HIV Infected Individuals with HAART by Intermittent IL-2 
Administration," AIDS, 17 (2003), 1621-1630. 


8.5.5. A study by Górecka et al. (A-26) assessed the manner in which among middle-aged smokers the 
diagnosis of airflow limitation (AL) combined with advice to stop smoking influences the smoking 
cessation rate. Their concerns were whether having AL, whether the subject successfully quit 
smoking, and whether interaction between AL and smoking status were significant factors in regard 
to baseline variables and lung capacity variables at the end of the study. Some of the variables of 
interest were previous years of smoking (pack years), age at which subject first began smoking, 
forced expiratory volume in one second (FEV), and forced vital capacity (FVC). There were 368 
subjects in the study. What are the factors in this study? At how many levels does each occur? Who 
are the subjects? What is (are) the response variable(s)? Can you think of any extraneous variables 
whose effects are included in the error term? 


8.5.6. А study by Meltzer et al. (A-27) examined the response to 5 mg desloratadine, an H1-receptor 
antagonist, in patients with seasonal allergies. During the fall allergy season, 172 subjects were 
randomly assigned to receive treatments of desloratadine and 172 were randomly assigned to receive 
a placebo. Subjects took the medication for 2 weeks after which changes in the nasal symptom score 
were calculated. A significant reduction was noticed in the treatment group compared to the placebo 
group, but gender was not a significant factor. What are the factors in the study? At how many levels 
does each occur? What is the response variable? 


8.6 SUMMARY 


The purpose of this chapter is to introduce the student to the basic ideas and techniques of 
analysis of variance. Two experimental designs, the completely randomized and the 
randomized complete block, are discussed in considerable detail. In addition, the concept 
of repeated measures designs and a factorial experiment as used with the completely 
randomized design are introduced. Individuals who wish to pursue further any aspect of 
analysis of variance will find the methodology references at the end of the chapter most 
helpful. 
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SUMMARY OF FORMULAS FOR CHAPTER 8 


Formula 
Number Name Formula 
8.2.1 One-way ANOVA Xij = U + tj + €ij 
model 
8.2.2 Total sum-of-squares k т А 
SST = 2.2 0 X ) 
j-l i=1 
8.2.3 Within-group k т " 
sum-of-squares SSW — 5 5 (ху x хі) 
j=l il 
8.2.4 Among-group К > 
sum-of-squares SSA — 5 nj (x 17-Х ) 
j=1 
8.2.5 Within-group variance k QU 2 
07 (xi =x j) 
мѕу = LL 
$(n-1) 
Al 
8.2.6 Among-group о? = no? 
variance I 
8.2.7 Among-group k А 
уапапсе П п У: (ху - z.) 
(equal sample sizes) MSA = Jl 
k—1 
8.2.8 Among-group k 5 
variance III bS nj (ху п х.) 
(unequal sample sizes) | MsA = =! 
k—1 
8.2.9 Tukey's HSD MSE 
(equal sample sizes) HSD = qa k N-k "XT 
8.2.10 Tukey's HSD MSE/1 1 
(unequal sample sizes) | HSD* = qa ру G + =) 
K, 2 ni nj 
8.3.1 Two-way ANOVA хі = U + Bit т + ey 
model 
8.3.2 Sum-of-squares SST = SSBI + SSTr + SSE 
representation 
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8.3.3 


Sum-of-squares total 


т = УУ ux 


j=l i=l 


8.3.4 


8.3.5 


Sum-of-squares block 


Sum-of-squares 
treatments 


k n 
5581 - M x -xy 
j=l i=l 


SSTr = УУ (xx 


j=l i=l 


8.3.6 


Sum-of-squares error 


SSE = SST — SSBI — SSTr 


8.4.1 


Fixed-effects, additive 


Xj = MAH В; + у + ey 


single-factor, repeated- 
measures ANOVA 
model 


8.4.2 Two-factor repeated 


measures model 


8.5.1 Two-factor completely 
randomized fixed- 


effects factorial model 


8.5.2 Probabilistic o «1—(1—o^)(1— o")(1— o") 
representation of o 
8.5.3 Sum-of-squares total I a bn a bon 
У: (ше-х.) = У) (xi EIU 
i=l j=1 k=1 i=l j=1 k=1 
a b n š 
ЧУ >> Cin 4) 
i=l j=l k=1 
8.5.4 Sum-of-squares total П | SST = SSTr + SSE 
8.5.5 Sum-of-squares a bn a bn 
treatment partition DD x y = 5 (x. ох) 
i=l j=l k=1 i=l j=l k=1 
a b n 5 
+) >> @,-я.) 
i=l j=l k=1 
a b n 
337» AER 
i=l j=l k=1 


Symbol Key * a = Probability of Type I error 

* a; = treatment A effect 

* В; = treatment B effect 

• p; = block effect 

• (o); = interaction effect 

e єї = error term 

e HSD = honestly significant difference 
* k = number of treatments 
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e и = mean of population(or the grand mean) 

* п = number or blocks 

* n, = sample size 

• pj; = block effect for two-factor repeated measures around 

. E — variance 

• SSX = sum — of — squares (where X : А = among, 
Bl — block, T — total, Tr — treatment, W — within) 

* т; = treatment effect 


* хх = measurement 
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Define analysis of variance. 

Describe the completely randomized design. 

Describe the randomized block design. 

Describe the repeated measures design. 

Describe the factorial experiment as used in the completely randomized design. 
What is the purpose of Tukey's HSD test? 

What is an experimental unit? 

What is the objective of the randomized complete block design? 
What is interaction? 

What is a mean square? 

What is an ANOVA table? 


For each of the following designs describe a situation in your particular field of interest where the 
design would be an appropriate experimental design. Use real or realistic data and do the appropriate 
analysis of variance for each one: 

(a) Completely randomized design 

(b) Randomized complete block design 

(c) Completely randomized design with a factorial experiment 


(d) Repeated measures designs 


Werther et al. (A-28) examined the 6-leucocyte count (x 10?/ L) in 51 subjects with colorectal cancer 
and 19 healthy controls. The cancer patients were also classified into Dukes's classification (A, B, C) 
for colorectal cancer that gives doctors a guide to the risk, following surgery, of the cancer coming 
back or spreading to other parts of the body. An additional category (D) identified patients with 
disease that had not been completely resected. The results are displayed in the following table. 
Perform an analysis of these data in which you identify the sources of variability and specify the 
degrees of freedom for each. Do these data provide sufficient evidence to indicate that, on the 
average, leucocyte counts differ among the five categories? Let o — .01 and find the p value. Use 
Tukey's procedure to test for significant differences between individual pairs of sample means. 


14. 
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Healthy A B С D 
6.0 TU 10.4 8.0 9.5 
6.3 7.8 5.6 6.7 7.8 
5.1 6.1 7.0 9.3 5:7 
6.2 9.6 8.2 6.6 8.0 

10.4 5.5 9.0 9.3 9.6 
4.4 5.8 8.4 12 13.7 
7.4 4.0 8.1 52 6.3 
7.0 5.4 8.0 9.8 7:3 
5.6 6.5 6.2 6.2 
5.3 9.1 10.1 
2.6 11.0 9.3 
6.3 10.9 9.4 
6.1 10.6 6.5 
5.3 5.2 5.4 
5.4 7.9 7.6 
5.2 7.6 9.2 
4.3 5.8 
4.9 7.0 
7.3 
4.9 
6.9 
4.3 
5.6 
5.1 


Source: Data provided courtesy of Kim Werther, M.D., Ph.D. 
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In Example 8.4.1, we examined data from a study by Licciardone et al. (A-15) on osteopathic 
manipulation as a treatment for chronic back pain. At the beginning of that study, there were actually 
91 subjects randomly assigned to one of three treatments: osteopathic manipulative treatment 
(OMT), sham manipulation (SHAM), or non-intervention (CONTROL). One important outcome 
variable was the rating of back pain at the beginning of the study. The researchers wanted to know if 
the treatment had essentially the same mean pain level at the start of the trial. The results are 
displayed in the following table. The researchers used a visual analog scale from 0 to 10 cm where 10 
indicated “worst pain possible." Can we conclude, on the basis of these data, that, on the average, 
pain levels differ in the three treatment groups? Let o = .05 and find the p value. If warranted, use 
Tukey's procedure to test for differences between individual pairs of sample means. 


CONTROL SHAM OMT 

2.6 5.8 7.8 3.5 
5.6 1.3 4.1 3.4 
3.3 2.4 1.7 1.1 
4.6 1.0 3.3 0.5 
8.4 32 4.3 5.1 
0.0 0.4 6.5 1.9 
2.5 5.4 5.4 2.0 
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CONTROL SHAM OMT 
5.0 4.5 4.0 2.8 
1.7 1.5 4.1 31 
3.8 0.0 2.6 1.6 
2.4 0.6 3.2 0.0 
1.1 0.0 2.8 0.2 
0.7 7.6 3.4 7.3 
2.4 3.5 6.7 1.7 
3.3 3.9 7.3 7.5 
6.6 7.0 2.1 1.6 
0.4 7.4 3:1 3.0 
0.4 6.5 2.3 6.5 
0.9 1.6 4.4 3.0 
6.0 1.3 2.8 3.3 
6.6 0.4 7.3 
6.3 0.7 4.6 
7.0 7.9 4.8 
1.3 4.9 


Source: Data provided courtesy of J. C. Licciardone, D.O. 


The goal of a study conducted by Meshack and Norman (A-29) was to evaluate the effects of weights 
on postural hand tremor related to self-feeding in subjects with Parkinson's disease (PD). Each of the 
16 subjects had the tremor amplitude measured (in mm) under three conditions: holding a built-up 
spoon (108 grams), holding a weighted spoon (248 grams), and holding the built-up spoon while 
wearing a weighted wrist cuff (470 grams). The data are displayed in the following table. 


Tremor Amplitude (mm) 


Subject Built-Up Spoon Weighted Spoon Built-Up Spoon + Wrist Cuff 
1 77 1.63 1.02 
2 78 .88 1.11 
3 17 14 14 
4 .30 217 26 
5 29 27 .28 
6 1.60 1.49 1.73 
7 .38 .39 31 
8 24 24 24 
9 17 17 .16 

10 .38 .29 327. 

11 .93 1.21 90 

12 .63 52 .66 

13 49 73 76 

14 42 .60 .29 

15 .19 21 21 

16 19 20 .16 


Source: Rubia P. Meshack and Kathleen E. Norman, “A Randomized Controlled Trial of the Effects of 
Weights on Amplitude and Frequency of Postural Hand Tremor in People with Parkinson's Disease," 
Clinical Rehabilitation, 16 (2003), 481—492. 
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Can one conclude on the basis of these data that the three experimental conditions, on the average, 
have different effects on tremor amplitude? Let о = .05. Determine the p value. 


In a study of pulmonary effects on guinea pigs, Lacroix et al. (A-30) exposed 18 ovalbumin- 
sensitized guinea pigs and 18 nonsensitized guinea pigs to regular air, benzaldehyde, and 
acetaldehyde. At the end of exposure, the guinea pigs were anesthetized and allergic 
responses were assessed in bronchoalveolar lavage (BAL). The following table shows the 
alveolar cell count (x 106) by treatment group for the ovalbumin-sensitized and nonsensitized 
guinea pigs. 


Ovalbumin-Sensitized Treatment Alveolar Count x 10% 
no acetaldehyde 49.90 
no acetaldehyde 50.60 
no acetaldehyde 50.35 
no acetaldehyde 44.10 
no acetaldehyde 36.30 
no acetaldehyde 39.15 
no air 24.15 
no air 24.60 
no air 22.55 
no air 25.10 
no air 22.65 
no air 26.85 
no benzaldehyde 31.10 
no benzaldehyde 18.30 
no benzaldehyde 19.35 
no benzaldehyde 15.40 
no benzaldehyde 27.10 
no benzaldehyde 21.90 
yes acetaldehyde 90.30 
yes acetaldehyde 72.95 
yes acetaldehyde 138.60 
yes acetaldehyde 80.05 
yes acetaldehyde 69.25 
yes acetaldehyde 31.70 
yes air 40.20 
yes air 63.20 
yes air 59.10 
yes air 79.60 
yes air 102.45 
yes air 64.60 
yes benzaldehyde 22.15 
yes benzaldehyde 22.75 
yes benzaldehyde 22.15 
yes benzaldehyde 37.85 
yes benzaldehyde 19.35 
yes benzaldehyde 66.70 


Source: Data provided courtesy of G. Lacroix, Docteur en Toxicologie. 


380 CHAPTERS ANALYSIS OF VARIANCE 


17. 


Test for differences (a) between ovalbumin-sensitized and nonsensitized outcomes, (b) among the 
three different exposures, and (c) interaction. Let о = .05 for all tests. 


Watanabe et al. (A-31) studied 52 healthy middle-aged male workers. The researchers used the 
Masstricht Vital Exhaustion Questionnaire to assess vital exhaustion. Based on the resultant scores, 
they assigned subjects into three groups: VEI, VE2, and VE3. VEI indicates the fewest signs of 
exhaustion, and VE3 indicates the most signs of exhaustion. The researchers also asked subjects 
about their smoking habits. Smoking status was categorized as follows: ЗМОКЕ! are nonsmokers, 
SMOKE? are light smokers (20 cigarettes or fewer per day), SMOKE3 are heavy smokers (more than 
20 cigarettes per day). One of the outcome variables of interest was the amplitude of the high- 
frequency spectral analysis of heart rate variability observed during an annual health checkup. This 
variable, HF-amplitude, was used as an index of parasympathetic nervous function. The data are 
summarized in the following table: 


HF-Amplitude 
Smoking Status 
Vital Exhaustion 
Group SMOKEI SMOKE2 SMOKE3 
VEI 23.33 13.37 16.14 16.83 
31.82 9.76 20.80 29.40 
10.61 2224 15.44 6.50 
42.59 8.77 13.73 10.18 
23.15 20.28 13.86 
17.29 
VE2 20.69 11.67 44.92 27.91 
16.21 30.17 36.89 
28.49 29.20 16.80 
25.67 8.73 17.08 
15.29 9.08 18.77 
7.51 22.53 18.33 
22.03 17.19 
10.27 
VE3 9.44 17.59 5.57 
19.16 18.90 13.51 
14.46 17.37 
10.63 
13.83 


Source: Data provided courtesy of Takemasa Watanabe, M.D., Ph.D. 


Perform an analysis of variance on these data and test the three possible hypotheses. Let 
o! = a" = a" = .05. Determine the p values. 


18. 


19. 
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The effects of thermal pollution on Corbicula fluminea (Asiatic clams) at three different geographi- 
cal locations were analyzed by John Brooker (A-32). Sample data on clam shell length, width, and 
height are displayed in the following table. Determine if there is a significant difference in mean 
length, height, or width (measured in mm) of the clam shell at the three different locations by 
performing three analyses. What inferences can be made from your results? What are the 
assumptions underlying your inferences? What are the target populations? 


Location 1 Location 2 Location 3 
Length Width Height | Length Width Height | Length Width Height 
7.20 6.10 4.45 7.25 6.25 4.65 5.95 4.75 3.20 
7.50 5.90 4.65 7.23 5.99 4.20 7.60 6.45 4.56 
6.89 5.45 4.00 6.85 5.61 4.01 6.15 5.05 3.50 
6.95 5.76 4.02 7.07 5.91 4.31 7.00 5.80 4.30 
6.73 5.36 3.90 6.55 5.30 3.95 6.81 5.61 4.22 
7.25 5.84 4.40 7.43 6.10 4.60 7.10 5.75 4.10 
7.20 5.83 4.19 7.30 5.95 4.29 6.85 5.55 3.89 
6.85 5.75 3.95 6.90 5.80 4.33 6.68 5.50 3.90 
7.52 6.27 4.60 7.10 5.81 4.26 5.51 4.52 2.70 
7.01 5.65 4.20 6.95 5.65 4.31 6.85 5.53 4.00 
6.65 5.55 4.10 7.39 6.04 4.50 7.10 5.80 4.45 
7.55 6.25 4.72 6.54 5.89 3.65 6.81 5.45 3.51 
7.14 5.65 4.26 6.39 5.00 3.72 7.30 6.00 4.31 
7.45 6.05 4.85 6.08 4.80 3.51 7.05 6.25 4.71 
7.24 5.73 4.29 6.30 5.05 3.69 6.75 5.65 4.00 
7.15 6.35 4.85 6.35 5.10 3.73 6.75 5.57 4.06 
6.85 6.05 4.50 7.34 6.45 4.55 7.35 6.21 4.29 
6.50 5.30 3.73 6.70 5.51 3.89 6.22 5.11 3.35 
6.64 5.36 3.99 7.08 5.81 4.34 6.80 5.81 4.50 
7.19 5.85 4.05 7.09 5.95 4.39 6.29 4.95 3.69 
7.15 6.30 4.55 7.40 6.25 4.85 7.55 5.93 4.55 
7.21 6.12 4.37 6.00 4.75 3.37 7.45 6.19 4.70 
7.15 6.20 4.36 6.94 5.63 4.09 6.70 5.55 4.00 
7.30 6.15 4.65 7.51 6.20 4.74 
6.35 5.25 3.75 6.95 5.69 4.29 
7.50 6.20 4.65 


Source: Data provided courtesy of John Brooker, M.S. and the Wright State University Statistical 
Consulting Center. 


Eleftherios Kellis (A-33) conducted an experiment on 18 pubertal males. He recorded the 
electromyographic (EMG) activity at nine different angular positions of the biceps femoris 
muscle. The EMG values are expressed as a percent (0—100 percent) of the maximal effort exerted 
with the muscle and represent an average in a range of flexion angles. The nine positions 
correspond to testing knee flexion angles of 1-10°, 11—20°, 21—30°, 31—40°, 41—50°, 51—60°, 
61—70°, 71—80°, and 81—90°. The results are displayed in the following table. For subject 1, for 
example, the value of 30.96 percent represents the average maximal percent of effort in angular 
positions from 1 to 10 degrees. 
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Subject 1-10° 11-20* 21-30* 31-40* 41-50* 51-60* 61—70* 71-80* 81—90° 


1 30.96 11.32 4.34 5.99 8.43 10.50 4.49 10.93 33.26 
2 3.61 1.47 3.50 10.25 3.30 3.62 10.14 11.05 8.78 
3 8.46 2.94 1.83 5.80 11.59 15.17 13.04 10.57 8.22 
4 0.69 1.06 1.39 1.08 0.96 2.52 2.90 3.27 9.92 
5 4.40 3.02 3.74 3.83 3.73 10.16 9.31 12.70 11.45 
6 4.59 9.80 10.71 11.64 9.78 6.91 8.53 8.30 11.75 
7 3.31 3.31 4.12 12.56 4.60 1.88 2.42 2.46 2.19 
8 1.98 6.49 2.61 3.28 10.29 7.56 16.68 14.52 13.49 
9 10.43 4.96 12.37 24.32 17.16 34.71 35.30 37.03 45.65 
10 20.91 20.72 12.70 15.06 12.03 11.31 28.47 26.81 25.08 
11 5.59 3.13 2.83 4.31 6.37 13.95 13.48 11.15 30.97 
12 8.67 4.32 2.29 6.20 13.01 19.30 9.33 12.30 12.20 
13 2.11 1.59 2.40 2.56 2.83 2.55 5.84 5.23 8.84 
14 3.82 5.04 6.81 10.74 10.10 13.14 19.39 13.31 12.02 
15 39.51 62.34 70.46 20.48 17.38 54.04 25.76 50.32 46.84 
16 3.31 4.95 12.49 9.18 14.00 16.17 25.75 11.82 13.17 
17 11.42 7.53 4.65 4.70 7.57 9.86 5.30 447 3.99 
18 2.97 2.18 2.36 4.61 7.83 17.49 42.55 61.84 39.70 


Source: Data provided courtesy of Eleftherios Kellis, Ph.D. 


Can we conclude on the basis of these data that the average EMG values differ among the nine 
angular locations? Let о = .05. 


20. Ina study of Marfan syndrome, Pyeritz et al.(A-34) reported the following severity scores of patients 
with no, mild, and marked dural ectasia. May we conclude, on the basis of these data, that mean severity 
scores differ among the three populations represented in the study? Leto: — .05 and find the p value. Use 
Tukey's procedure to test for significant differences among individual pairs of sample means. 


No dural ectasia: 18, 18, 20, 21, 23, 23, 24, 26, 26, 27, 28, 29, 29, 29, 30, 30, 30, 
30, 32, 34, 34, 38 

Mild dural ectasia: 10, 16, 22, 22, 23, 26, 28, 28, 28, 29, 29, 30, 31, 32, 32, 33,33, 
38, 39, 40, 47 

Marked dural ectasia: 17, 24, 26, 27, 29, 30, 30, 33, 34, 35, 35, 36, 39 

Source: Data provided courtesy of Reed E. Pyeritz, M.D., Ph.D. 


21. The following table shows the arterial plasma epinephrine concentrations (nanograms per milliliter) 
found in 10 laboratory animals during three types of anesthesia: 


Animal 
Anesthesia 1 2 3 4 5 6 7 8 9 10 
A .28 .50 .68 27 31 .99 .26 .35 .38 34 
B 20 .38 .50 .29 .38 .62 42 87 31 43 


C 1,23 1.34 55 1.06 48 .68 1.12 1.52 27 .35 


Can we conclude from these data that the three types of anesthesia, on the average, have different 
effects? Let a = .05. 


22. 


23. 


The aim of a study by Hartman-Maeir et al. (A-35) was to evaluate the awareness of deficit profiles 
among stroke patients undergoing rehabilitation. She studied 35 patients with a stroke lesion in the 
right hemisphere and 19 patients with a lesion on the left hemisphere. She also grouped lesion size as 


One of the outcome variables was a measure of each patient's total unawareness of their own 
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2 = “1-3 ст”, 3 = “3-5 cm”, and 4 = “5 ст ог greater” 


limitations. Scores ranged from 8 to 24, with higher scores indicating more unawareness. 


Unawareness Score 


Lesion Size Left Right 

Group Hemisphere Hemisphere 

2 11 10 8 
13 11 10 
10 13 9 
11 10 9 
9 13 9 
10 10 
9 10 
8 9 
10 8 

3 13 11 10 
8 10 11 
10 10 12 
10 14 11 
10 8 

4 11 10 11 
13 13 9 
14 10 19 
13 10 10 
14 15 9 

8 1 


Source: Data provided courtesy of 
Adina Hartman-Maeir, Ph.D., O.T.R. 


Test for a difference in lesion size, hemisphere, and interaction. Let œ = .05 for all tests. 


A random sample of the records of single births was selected from each of four populations. The 


weights (grams) of the babies at birth were as follows: 


Sample 
A B С D 
2946 3186 2300 2286 
2913 2857 2903 2938 
2280 3099 2572 2952 
3685 2761 2584 2348 


(Continued) 
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24. 


25. 


Sample 

A B С D 

2310 3290 2675 2691 

2582 2937 2571 2858 

3002 3347 2414 

2408 2008 
2850 
2762 


Do these data provide sufficient evidence to indicate, at the .05 level of significance, that the four 
populations differ with respect to mean birth weight? Test for a significant difference between all 
possible pairs of means. 


The following table shows the aggression scores of 30 laboratory animals reared under three different 
conditions. One animal from each of 10 litters was randomly assigned to each of the three rearing 
conditions. 


Rearing Condition 


Extremely Moderately Not 

Litter Crowded Crowded Crowded 
1 30 20 10 
2. 30 10 20 
3 30 20 10 
4 25 15 10 
5 35 25 20 
6 30 20 10 
7 20 20 10 
8 30 30 10 
9 25 25 10 
10 30 20 20 


Do these data provide sufficient evidence to indicate that level of crowding has an effect on 
aggression? Let o = .05. 


The following table shows the vital capacity measurements of 60 adult males classified by occupation 
and age group: 


Occupation 
Age Group A B С D 
1 4.31 4.68 4.17 5.75 
4.89 6.18 3.77 5.70 
4.05 4.48 5.20 5.53 
4.44 4.23 5.28 5.97 
4.59 5.92 4.44 5.52 


(Continued) 
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Occupation 

Age Group A B С D 

2 4.13 3.41 3.89 4.58 
4.61 3.64 3.64 5.21 
3.91 3.32 4.18 5.50 
4.52 3.51 4.48 5.18 
4.43 3.75 4.27 4.15 

3 3.79 4.63 5.81 6.89 
4.17 4,59 5.20 6.18 
4.47 4.90 5.34 6.21 
4.35 5.31 5.94 7.56 
3.59 4.81 5.56 6.73 


Test for differences among occupations, for differences among age groups, and for interaction. 
Let a = .05 for all tests. 


Complete the following ANOVA table and state which design was used. 


Source 55 d.f. MS V.R. Р 
Treatments 154.9199 4 

Error 

Total 200.4773 39 


Complete the following ANOVA table and state which design was used. 


Source SS d.f. MS V.R. Р 
Treatments 3 

Blocks 183.5 3 

Error 26.0 

Total 709.0 15 


Consider the following ANOVA table. 


Source SS d.f. MS V.R. р 

А 12.3152 2 6.15759 29.4021 <.005 
В 19.7844 3 6.59481 31.4898 <.005 
AB 8.94165 6 1.49027 7.11596 <.005 
Treatments 41.0413 11 

Error 10.0525 48 0.209427 


Total 51.0938 59 
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(a) What sort of analysis was employed? 
(b) What can one conclude from the analysis? Let œ = .05. 


29. Consider the following ANOVA table. 


Source SS af. MS V.R. 
Treatments 5.05835 2 2.52917 1.0438 
Error 65.42090 27 2.4230 


(a) What design was employed? 

(b) How many treatments were compared? 

(c) How many observations were analyzed? 

(d) At the .05 level of significance, can one conclude that there is a difference among treatments? 
Why? 


30. Consider the following ANOVA table. 


Source SS d.f. MS V.R. 
Treatments 231.5054 2 115.7527 2.824 
Blocks 98.5000 7 14.0714 
Error 573.7500 14 40.9821 


(a) What design was employed? 

(b) How many treatments were compared? 

(c) How many observations were analyzed? 

(d) At the .05 level of significance, can one conclude that the treatments have different effects? Why? 


31. Ina study of the relationship between smoking and serum concentrations of high-density lipoprotein 
cholesterol (HDL-C), the following data (coded for ease of calculation) were collected from samples 
of adult males who were nonsmokers, light smokers, moderate smokers, and heavy smokers. We wish 
to know if these data provide sufficient evidence to indicate that the four populations differ with 
respect to mean serum concentration of HDL-C. Let the probability of committing a type I error be 
.05. If an overall significant difference is found, determine which pairs of individual sample means 
are significantly different. 


Smoking Status 

Nonsmokers Light Moderate Heavy 
12 9 5 3 
10 8 4 2 
11 5 7 1 
13 9 9 5 

9 9 5 4 

9 10 7 6 
12 8 6 2 
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32. Polyzogopoulou et al. (A-36) report the effects of bariatric surgery on fasting glucose levels (mmol/L) 
on 12 obese subjects with type 2 diabetes at four points in time: pre-operation, at 3 months, 6 months, 
and 12 months. Can we conclude, after eliminating subject effects, that fasting glucose levels differ over 
time after surgery? Let o = .05. 


Subject No. Pre-op 3 Months 6 Months 12 Months 
1 108.0 200.0 94.3 92.0 
2 96.7 119.0 84.0 93.0 
3 77.0 130.0 76.0 74.0 
4 92.0 181.0 82.5 80.5 
5 97.0 134.0 81.0 76.0 
6 94.0 163.0 96.0 71.0 
7 76.0 125.0 74.0 75.5 
8 100.0 189.0 97.0 88.5 
9 82.0 282.0 91.0 93.0 

10 103.5 226.0 86.0 80.5 

11 85.5 145.0 83.5 83.0 

12 74.5 156.0 71.0 87.0 


Source: Data provided courtesy of Theodore К. Alexandrides, M.D. 


33. Refer to Review Exercise 32. In addition to studying the 12 type 2 diabetes subjects (group 1), 
Polyzogopoulou et al. (A-36) studied five subjects with impaired glucose tolerance (group 2), and 
eight subjects with normal glucose tolerance (group 3). The following data are the 12-month post- 
surgery fasting glucose levels for the three groups. 


Group 

1.0 92.0 
1.0 93.0 
1.0 74.0 
1.0 80.5 
1.0 76.0 
1.0 71.0 
1.0 75.5 
1.0 88.5 
1.0 93.0 
1.0 80.5 
1.0 83.0 
1.0 87.0 
2.0 79.0 
2.0 78.0 
2.0 100.0 
2.0 76.5 
2.0 68.0 
3.0 81.5 
3.0 75.0 
3.0 76.5 
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34. 


35. 


36. 


37. 


38. 


Group 

3.0 70.5 
3.0 69.0 
3.0 73.8 
3.0 74.0 
3.0 80.0 


Source: Data provided courtesy of 
Theodore K. Alexandrides, M.D. 


Can we conclude that there is a difference among the means of the three groups? If so, which pairs of 
means differ? Let o — .05 for all tests. 


For exercises 34 to 38 do the following: 


(a) Indicate which technique studied in this chapter (the completely randomized design, the 
randomized block design, the repeated measures design, or the factorial experiment) is appropriate. 


(b) Identify the response variable and treatment variables. 


(c) As appropriate, identify the factors and the number of levels of each, the blocking variables, and 
the subjects. 


(d) List any extraneous variables whose effects you think might be included in the error term. 
(e) As appropriate, comment on carry-over and position effects. 


(f) Construct an ANOVA table in which you indicate the sources of variability and the number of 
degrees of freedom for each. 


Johnston and Bowling (A-37) studied the ascorbic acid content (vitamin C) in several orange juice 
products. One of the products examined was ready-to-drink juice packaged in a re-sealable, screw- 
top container. One analysis analyzed the juice for reduced and oxidized vitamin C content at time of 
purchase and reanalyzed three times weekly for 4 to 5 weeks. 


A study by Pittini et al. (A-38) assessed the effectiveness of a simulator-based curriculum on 30 
trainees learning the basic practice of amniocentesis. Pre- and post-training performance were 
evaluated with the same instrument. The outcome variable was the post-training score—pretraining 
score. Trainees were grouped by years of postgraduate experience: PGY 0-2, PGY 3-5, Fellows, and 
Faculty. 


Anim-Nyame et al. (A-39) studied three sets of women in an effort to understand factors related to 
pre-eclampsia. Enrolled in the study were 18 women with pre-eclampsia, 18 normal pregnant 
women, and 18 nonpregnant female matched controls. Blood samples were obtained to measure 
plasma levels of vascular endothelial growth factor, leptin, TNF-o plasma protein concentrations, and 
full blood count. 


In a study by lwamoto et al. (A-40) 26 women were randomly assigned to the medication alfacalcidol 
for treatment of lumbar bone mineral density (BMD). BMD of the lumbar spine was measured at 
baseline and every year for 5 years. 


Inoue et al. (A-41) studied donor cell type and genotype on the efficiency of mouse somatic cell 
cloning. They performed a factorial experiment with two donor cell types (Sertoli cells or cumulus) 
and six genotypes. Outcome variables were the cleavage rate and the birth rate of pups in each 
treatment combination. 


39. 
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For the studies described in Exercises 39 through 66, do the following: 


(a) Perform a statistical analysis of the data (including hypothesis testing and confidence interval 
construction) that you think would yield useful information for the researchers. 


(b) Determine p values for each computed test statistic. 
(c) State all assumptions that are necessary to validate your analysis. 


(d) Describe the population(s) about which you think inferences based on your analysis would be 
applicable. 


Shirakami et al. (A-42) investigated the clinical significance of endothelin (ET), natriuretic peptides, 
and the renin-angiotensin-aldosterone system in pediatric liver transplantation. Subjects were 
children ages 6 months to 12 years undergoing living-related liver transplantation due to congenital 
biliary atresia and severe liver cirrhosis. Among the data collected were the following serum total 
bilirubin (mg/dl) levels after transplantation (h—hours, d—days): 


Preoperative 


Time After Reperfusion of Donor Liver 


Liver Transection | Anhepatic Phase 1h 2h 4h Sh 1d 2d 3d 


6.2 
17.6 
13.2 

3.9 
20.8 

1.8 

8.6 
13.4 
16.8 
20.4 
25 

9.2 

8 

2.9 
21.3 
25 
23.3 
17.5 


1.2 0.9 0.8 1.1 1.5 2 1.4 1.6 1.3 
11.9 9.3 3.5 3 6.1 9 6.3 6.4 6.2 
10.2 7.9 5.3 4.9 3.3 3.6 2.8 1.9 1.9 

3.3 3 2.9 2.3 1.4 1.2 0.8 0.8 0.9 
19.4 4 9.4 8.4 6.8 7.1 3.7 3.8 32 

1.8 1.6 1.4 1.4 1.1 1.9 0.7 0.8 0.7 

6.5 4.8 3.1 2.1 1 1.3 1.5 1.6 3.2 
12 10.1 5.8 5.6 4.5 4.1 3 3.1 3.6 
13.9 8.3 3.7 ЭРТ 2.2 2.1 1.9 3.1 4.1 
17.8 17 10.8 9.3 8.9 7 2.8 3.8 4.8 
21.5 13.8 7.6 7 5 11.5 12.3 10.1 11.4 

6.3 6.8 5.3 4.8 0.2 4 4.2 3.7 3.5 

6.5 6.4 4.1 3.8 3.8 3.5 3.1 2.9 2.8 

3 4.1 3.4 3.4 3.4 4.2 3.3 2 1.9 
17.3 13.6 9.2 7.9 7.9 9.8 8.6 4.7 5.5 
25 24 20.1 19.3 18.6 23.6 25 144 20.6 
23.7 157 13.2 11 9.6 9.3 7.2 6.3 6.3 
16.2 14.4 12.6 12.7 11.5 10 7.8 5.5 4.9 


* Missing observation. 
Source: Data provided courtesy of Dr. Gotaro Shirakami. 


Note that there is a missing observation in the data set. You may handle this problem in at least three 
ways. 


(a) Omit the subject whose datum is missing, and analyze the data of the remaining 17 subjects. 
(b) Use a computer package that automatically deals with missing data. 


(c) Analyze the data using a missing data procedure. For such a procedure, see Jerome L. Myers and 
Arnold D. Well, Research Design and Statistical Analysis, Erlbaum Associates, Hillsdale, NJ, 1995, 
pp. 256-258. 
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40. 


41. 


The purpose of a study by Sakakibara and Hayano (A-43) was to examine the effect of voluntarily 
slowed respiration on the cardiac parasympathetic response to a threat (the anticipation of an 
electric shock). Subjects were 30 healthy college students whose mean age was 23 years with a 
standard deviation of 1.5 years. An equal number of subjects were randomly assigned to slow (six 
males, four females), fast (seven males, three females), and nonpaced (five males, five females) 
breathing groups. Subjects in the slow- and fast-paced breathing groups regulated their breathing 
rate to 8 and 30 cpm, respectively. The nonpaced group breathed spontaneously. The following are 
the subjects” scores on the State Anxiety Score of State-Trait Anxiety Inventory after baseline and 
period of threat: 


Slow paced Fast paced Nonpaced 


Baseline Threat Baseline Threat Baseline Threat 


39 59 37 49 36 51 

44 47 40 42 34 71 

48 Si 39 48 50 37 

50 61 47 57 49 53 

34 48 45 49 38 52 

54 69 43 44 39 56 

34 43 32 45 66 67 

38 52 27]. 54 39 49 

44 48 44 44 45 65 Source: Data provided courtesy 
39 65 4l 61 42 57 of Dr. Masahito Sakakibara. 


Takahashi et al. (A-44) investigated the correlation of magnetic resonance signal intensity with spinal 
cord evoked potentials and spinal cord morphology after 5 hours of spinal cord compression in cats. 
Twenty-four adult cats were divided into four groups on the basis of a measure of spinal cord function 
plus a control group that did not undergo spinal compression. Among the data collected were the 
following compression ratio [(sagittal diameter/transverse diameter) х 100] values after 5 hours of 
compression: 


Control 80.542986 | Group Ш 36.923077 
79.111111 31.304348 
70.535714 53.333333 
87.323944 55.276382 
80.000000 40.725806 
82.222222 —————————————— 
Group IV 66.666667 
GroupI 83.928571 29.565217 
84.183673 12.096774 
48.181818 34.274194 
98.461538 24.000000 
Group II 30.263158 
a Source: Data provided 


courtesy of Dr. Toshiaki 
82.439024 Takahashi. 
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42. The objective of a study by Yamashita et al. (A-45) was to investigate whether pentoxifylline 
administered in the flush solution or during reperfusion would reduce ischemia-reperfusion lung 
injury in preserved canine lung allografts. Three groups of animals were studied. Pentoxifylline was 
not administered to animals in group 1 (C), was administered only during the reperfusion period (P) 
to animals in group 2, and was administered only in the flush solution to animals in group 3 (F). A 
total of 14 left lung allotransplantations were performed. The following are the aortic pressure 
readings for each animal during the 6-hour assessment period: 


0 60 120 180 240 300 360 
Group min min min min min min min 
85.0 100.0 120.0 80.0 72.0 75.0 * 


85.0 82.0 80.0 80.0 85.0 80.0 80.0 
100.0 75.0 85.0 98.0 85.0 80.0 82.0 
57.0 57.0 57.0 30.0 й T i 
57.0 75.0 52.0 56.0 65.0 95.0 75.0 
112.0 67.0 73.0 90.0 71.0 70.0 66.0 
92.0 70.0 90.0 80.0 75.0 80.0 2, 
105.0 62.0 73.0 75.0 70.0 55.0 50.0 
80.0 73.0 50.0 35.0 | * і 
70.0 95.0 105.0 115.0 110.0 105.0 100.0 
60.0 63.0 140.0 135.0 125.0 130.0 120.0 
67.0 65.0 75.0 75.0 80.0 80.0 80.0 
115.0 107.0 90.0 103.0 110.0 112.0 95.0 
90.0 99.0 102.0 110.0 117.0 118.0 103.0 


{нн РИ ЕП Ө я РӘ СУ СУ СУС б 


* Missing observation. 
Source: Data provided courtesy of Dr. Motohiro Yamashita. 


43. In a study investigating the relative bioavailability of beta-carotene (BC) and alpha-carotene 
(AC) from different sources of carrots, Zhou et al. (A-46) used ferrets as experimental animals. 
Among the data collected were the following concentrations of BC, AC, and AC/BC molar ratios 
in the sera of 24 ferrets provided with different sources of carotenoids for 3 days in their drinking 


water: 

BC AC AC/BC 

(umol/g) (umol/g) (mol/mol) 
Unheated Juice 

0.637 0.506 0.795 

0.354 0.297 0.840 

0.287 0.249 0.869 

0.533 0.433 0.813 

0.228 0.190 0.833 

0.632 0.484 0.767 

Heated Juice 
0.303 0.266 0.878 
0.194 0.180 0.927 
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44. 


BC AC AC/BC 
(umol/g) (ито) (mol/mol) 
Heated Juice 
0.293 0.253 0.864 
0.276 0.238 0.859 
0.226 0.207 0.915 
0.395 0.333 0.843 
Unheated Chromoplast 

0.994 0.775 0.780 
0.890 0.729 0.819 
0.809 0.661 0.817 
0.321 0.283 0.882 
0.712 0.544 0.763 


0.949 0.668 0.704 


Heated Chromoplast 


0.933 0.789 0.845 
0.280 0.289 1.031 
0.336 0.307 0.916 
0.678 0.568 0.837 
0.714 0.676 0.947 
0.757 0.653 0.862 Source: Data provided 


courtesy of Dr. Jin-R. Zhou. 


Potteiger et al. (A-47) wished to determine if sodium citrate ingestion would improve cycling 
performance and facilitate favorable metabolic conditions during the cycling ride. Subjects were 
eight trained male competitive cyclists whose mean age was 25.4 years with a standard deviation of 
6.5. Each participant completed a 30-km cycling time trial under two conditions, following ingestion 
of sodium citrate and following ingestion of a placebo. Blood samples were collected prior to 
treatment ingestion (PRE-ING); prior to exercising (PRE-EX); during the cycling ride at completion 
of 10, 20, and 30 km; and 15 minutes after cessation of exercise (POST-EX). The following are the 
values of partial pressures of oxygen (Po2) and carbon dioxide (Pco») for each subject, under each 
condition, at each measurement time: 


(Роз) (mm Hg) 


Measurement Times 


Subject Treatment? PRE-ING PRE-EX 10-km 20-km 30-km 15-POST-EX 
1 1 42.00 20.00 53.00 51.00 56.00 41.00 
1 2 43.00 29.00 58.00 49.00 55.00 56.00 
2 1 44.00 38.00 66.00 66.00 76.00 58.00 
2 2 40.00 26.00 57.00 47.00 46.00 45.00 
3 1 37.00 22.00 59.00 58.00 56.00 52.00 


(Continued) 
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(Роз) (mm Hg) 


Measurement Times 
Subject Treatment? PRE-ING PRE-EX 10-km 20-km 30-km 15-POST-EX 


3 2 36.00 30.00 52.00 65.00 65.00 36.00 
4 1 34.00 21.00 65.00 62.00 62.00 59.00 
4 2 46.00 36.00 65.00 72.00 72.00 66.00 
5 1 36.00 24.00 41.00 43.00 50.00 46.00 
5 2 41.00 25.00 52.00 60.00 67.00 54.00 
6 1 28.00 31.00 52.00 60.00 53.00 46.00 
6 2 34.00 21.00 57.00 58.00 57.00 41.00 
7 1 39.00 28.00 72.00 69.00 65.00 72.00 
7 2 40.00 27.00 64.00 61.00 57.00 60.00 
8 1 49.00 27.00 67.00 61.00 51.00 49.00 
8 2 27.00 22.00 56.00 64.00 49.00 34.00 


(Рсо2) (mm Hg) 


Measurement Times 
Subject Treatment? PRE-ING PRE-EX 10-km 20-km 30-km 15-POST-EX 


1 1 31.70 30.20 28.20 29.80 28.20 30.10 
1 2 24.60 24.40 34.40 35.20 30.90 34.00 
2 1 27.10 35.90 31.30 35.40 34.10 42.00 
2 2 21.70 37.90 31.90 39.90 45.10 48.00 
3 1 37.40 49.60 39.90 39.70 39.80 42.80 
3 2 38.40 42.10 40.90 37.70 37.70 45.60 
4 1 36.60 45.50 34.80 33.90 34.00 40.50 
4 2 39.20 40.20 31.90 32.30 33.70 45.90 
5 1 33.70 39.50 32.90 30.50 28.50 37.20 
5 2 31.50 37.30 32.40 31.90 30.20 31.70 
6 1 35.00 41.00 38.70 37.10 35.80 40.00 
6 2 27.20 36.10 34.70 36.30 34.10 40.60 
7 1 28.00 36.50 30.70 34.60 34.30 38.60 
7 2 28.40 31.30 48.10 43.70 35.10 34.70 
8 1 22.90 28.40 25.70 28.20 32.30 34.80 
8 2 41.40 41.80 29.50 29.90 31.30 39.00 


21 = Sodium citrate; 2 = placebo. 
Source: Data provided courtesy of Dr. Jeffrey A. Potteiger. 


45. Teitge et al. (A-48) describe a radiographic method to demonstrate patellar instability. The 90 
subjects ranged in age from 13 to 52 years and were divided into the following four groups on 
the basis of clinical findings regarding the nature of instability of the knee: normal (no 
symptoms or signs related to the knee), lateral, medial, and multidirectional instability. Among 
the data collected were the following radiographic measurements of the congruence angle 
(degrees): 
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46. 


Normal Lateral Medial Multidirectional 
—8 4 12 —16 10 15 
—16 18 —8 —25 —5 —26 
—22 5 —8 20 -10 -8 
—26 —6 —20 —8 -12 -12 
-8 32 —5 8 —]4 —40 
12 30 -10 -14 -20 
—8 -10 —18 —16 
12 28 —4 —34 
—20 6 —20 —]4 
—20 9 —20 —6 
—5 10 —20 —35 
10 20 —22 —24 
—4 -9 —15 —25 
—2 —10 —10 10 
—6 12 —5 —16 
—7 0 —5 —30 
0 35 —6 —30 
-2 ESI —15 
—15 5 —25 
-5 22 -10 
22 —20 


Source: Data provided courtesy of Dr. Robert A. Teitge. 


A study by Ikeda et al. (A-49) was designed to determine the dose of ipratropium bromide aerosol 
that improves exercise performance using progressive cycle ergometry in patients with stable chronic 
obstructive pulmonary disease. The mean age of the 20 male subjects was 69.2 years with a standard 
deviation of 4.6 years. Among the data collected were the following maximum ventilation 
(VEmax,L/ min) values at maximum achieved exercise for different ipratropium bromide dosage 


levels (wg): 


Placebo 40 80 160 240 
26 24 23 25 28 
38 39 43 43 37 
49 46 54 57 52 
37 39 39 38 38 
34 33 37 37 41 
42 38 44 44 42 
23 26 28 27 22 
38 41 44 37 40 
37 37 36 38 39 
33 35 34 38 36 
40 37 40 46 40 
52 58 48 58 63 
45 48 47 51 38 
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Placebo 40 80 160 240 
24 30 23 27 30 
41 37 39 46 42 
56 54 51 58 58 
35 51 49 51 46 
28 41 37 33 38 
28 34 34 35 35 
38 40 43 39 45 


Source: Data provided courtesy of Dr. Akihiko Ikeda. 


Pertovaara et al. (A-50) compared the effect of skin temperature on the critical threshold temperature 
eliciting heat pain with the effect of skin temperature on the response latency to the first heat pain 
sensation. Subjects were healthy adults between the ages of 23 and 54 years. Among the data 
collected were the following latencies (seconds) to the first pain response induced by radiant heat 
stimulation at three different skin temperatures: 


Subject 25C 30°С 35°С 
1 64 4.5 3.6 
2 8.1 9:7 6.3 
3 9.4 6.8 312 
4 6.75 4.6 3.9 
3 10 6.2 6.2 
6 4.5 4.2 3.4 


Source: Data provided courtesy of Dr. Antti Pertovaara. 


A study for the development and validation of a sensitive and specific method for quantifying total 
activin-A concentrations has been reported on by Knight et al. (A-51). As part of the study they 
collected the following peripheral serum concentrations of activin-A in human subjects of 
differing reproductive status: normal follicular phase (FP), normal luteal phase (LP), pregnant 
(PREG), ovarian hyperstimulated for in vivo fertilization (HYP), postmenopausal (PM), and 
normal adult males. Hint: Convert responses to logarithms before performing analysis. 


FP LP PREG HYP PM Male 
134.5 78.0 2674.0 253.1 793.1 196.7 
159.2 130.4 945.6 294.3 385.1 190.6 


133.2 128.3 5507.6 170.2 270.9 185.3 
225.0 166.4 7196.5 219.8 640.3 335.4 
146.4 115.2 5077.5 165.8 459.8 214.6 
180.5 148.9 4541.9 159.0 


Source: Data provided courtesy of Dr. Philip G. Knight. 


The purpose of a study by Maheux et al. (A-52) was to evaluate the effect of labor on glucose 
production and glucose utilization. Subjects were six normal pregnant women. Among the data 
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collected were the following glucose concentrations during four stages of labor: latent (A1) and 
active (A2) phases of cervical dilatation, fetal expulsion (B), and placental expulsion (C). 


A1 A2 B С 

3.60 4.40 5.30 6.20 
3.53 3.70 4.10 3.80 
4.02 4.80 5.40 5.277 
4.90 5.33 6.30 6.20 
4.06 4.65 6.10 6.90 
3.97 5.20 4.90 4.60 


Source: Data provided courtesy of Dr. Pierre C. Maheux. 


Trachtman et al. (A-53) conducted studies (1) to assess the effect of recombinant human (rh) IGF-I on 
chronic puromycin aminonucleoside (PAN) nephropathy and (2) to compare the results of rhIGF-I 
versus rhGH treatment in a model of focal segmental glomerulosclerosis. As part of the studies, male 
Sprague-Dawley rats were divided into four groups: PAN (IA), PAN + rhIGF-I (IB), normal (ПА), 
and normal + rhIGF-I (IIB). The animals yielded the following data on creatinine levels before (pre) 
and after 4, 8, and 12 weeks of treatment: 


Group 
IA IB TIA TB 
Pre 
44 44 44 35 
44 44 44 44 
44 44 44 44 
53 44 44 35 
44 44 
44 53 
4 Weeks 
97 44 53 44 
88 35 44 53 
62 44 44 53 
53 35 53 44 
62 62 
53 53 
8 Weeks 
53 53 62 44 
53 53 53 62 
44 53 62 44 
53 44 53 44 
62 53 
70 62 
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Group 
IA IB TIA ПВ 
12 Weeks 
88 79 53 53 
70 79 62 62 
53 79 53 53 
70 62 62 53 
88 79 
88 70 


Source: Data provided courtesy of Dr. Howard Trachtman. 


51. Twelve healthy men, ages 22 through 35 years, yielded the following serum Тз (nmol/L) levels at 
0800 hours after 8 (day 1), 32 (day 2), and 56 (day 3) hours of fasting, respectively. Subjects were 
participants in a study of fasting-induced alterations in pulsatile glycoprotein secretion conducted by 
Samuels and Kramer (A-54). 
Subject T; Day Subject T; Day Subject T; Day Subject Т; Day 
1 88 1 2 115 1 3 119 1 4 164 1 
1 73 2 2 TI 2 3 93 2 4 120 
1 59 3 2 75 3 3 65 3 4 86 3 
Subject T; Day Subject T; Day Subject T; Day Subject T; Day 
5 93 1 6 119 1 7 152 1 8 121 1 
3 91 2 6 57 2 7 70 2 8 107 
3 113 3 6 44 3 7 74 3 8 133 3 
Subject T; Day Subject T; Day Subject T; Day Subject T; Day 
9 108 1 10 124 1 11 102 1 12 131 1 
9 93 2 10 97 2 11 56 2 12 83 
9 75 3 10 74 3 11 58 3 12 66 3 


Source: Data provided courtesy of Dr. Mary H. Samuels. 


52. 


To determine the nature and extent to which neurobehavioral changes occur in association with the 
toxicity resulting from exposure to excess dietary iron (Fe), Sobotka et al. (A-55) used weanling male 
Sprague-Dawley rats as experimental subjects. The researchers randomly assigned the animals, 
according to ranked body weights, to one of five diet groups differentiated on the basis of amount 
of Fe present: Control—35 (1), 350 (2), 3500 (3), 4 (iron deficient) (4), and 20,000 (5) ppm, 
respectively. The following are the body weights of the animals (grams) at the end of 10 weeks. 


Diet Weight Diet Weight Diet Weight 
1 396 1 335 1 373 
2 368 2 349 4 292 
3 319 3 302 5 116 
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Diet Weight Diet Weight Diet Weight 
4 241 4 220 4 29] 
5 138 5 118 5 154 
1 331 1 394 4 281 
2 325 2 300 5 118 
3 331 3 285 4 250 
4 232 4 237 5 119 
5 116 5 113 4 242 
1 349 1 377 5 118 
2 364 2 366 4 217 
3 392 3 269 5 104 
4 310 4 344 5 120 
5 131 5 Dead 5 102 
1 341 1 336 

2 399 2 379 

3 274 3 195 

4 319 4 217 

5 131 5 148 

1 419 1 301 

2. 373 2 368 

3 Dead 3 308 

4 220 4 299 

5 146 5 Dead 


Source: Data provided courtesy of Dr. Thomas J. Sobotka. 


53. Hansen (A-56) notes that brain bilirubin concentrations are increased by hyperosmolality and 
hypercarbia, and that previous studies have not addressed the question of whether increased brain 
bilirubin under different conditions is due to effects on the entry into or clearance of bilirubin from 
brain. In a study, he hypothesized that the kinetics of increased brain bilirubin concentration would 
differ in respiratory acidosis (hypercarbia) and hyperosmolality. Forty-four young adult male 
Sprague-Dawley rats were sacrificed at various time periods following infusion with bilirubin. 
The following are the blood bilirubin levels (mol/L) of 11 animals just prior to sacrifice 60 minutes 
after the start of bilirubin infusion: 


Controls Hypercarbia Hyperosmolality 
30 48 102 

94 20 118 

78 58 74 

52 74 


Source: Data provided courtesy of Dr. Thor Willy Ruud Hansen. 


54. Johansson et al. (A-57) compared the effects of short-term treatments with growth hormone (СН) and 
insulin-like growth factor I (IGF-I) on biochemical markers of bone metabolism in men with 
idiopathic osteoporosis. Subjects ranged in age from 32 to 57 years. Among the data collected were 
the following serum concentrations of IGF binding protein-3 at O and 7 days after first injection and 1, 
4, 8, and 12 weeks after last injection with GH and IGF-I. 
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Patient No. Treatment 0 Day 7 Days 1 Week 4 Weeks 8 Weeks 12 Weeks 
1 GH 4507 4072 3036 2484 3540 3480 
1 ІСЕ-І 3480 3515 4003 3667 4263 4797 
2 GH 2055 4095 2315 1840 2483 2354 
2 IGF-I 2354 3570 3630 3666 2700 2782 
3 GH 3178 3574 3196 2365 4136 3088 
3 IGF-I 3088 3405 3309 3444 2357 3831 
4 GH 3464 5874 2929 3903 3367 2938 
4 IGF-I 2905 2888 2797 3083 3376 3464 
5 GH 4142 4465 3967 4213 4321 4990 
5 IGF-I 4990 4590 2989 4081 4806 4435 
6 GH 3622 6800 6185 4247 4450 4199 
6 IGF-I 3504 3529 4093 4114 4445 3622 
7 GH 5390 5188 4788 4602 4926 5793 
7 IGF-I 5130 4784 4093 4852 4943 5390 
8 GH 3161 4942 3222 2699 3514 2963 
8 IGF-I 3074 2691 2614 3003 3145 3161 
9 GH 3228 5995 3315 2919 3235 4379 
9 IGF-I 4379 3548 3339 2379 2783 3000 

10 GH 5628 6152 4415 5251 3334 3910 

10 IGF-I 5838 5025 4137 5777 5659 5628 

11 GH 2304 4721 3700 3228 2440 2698 

11 IGF-I 2698 2621 3072 2383 3075 2822 


Source: Data provided courtesy of Dr. Anna G. Johansson. 


55. The objective of a study by Strijbos et al. (A-58) was to compare the results of a 12-week hospital- 
based outpatient rehabilitation program (group 1) with those of a 12-week home-care rehabilitation 
program (group 2) in chronic obstructive pulmonary disease with moderate to severe airflow 
limitation. A control group (group 3) did not receive rehabilitation therapy. Among the data collected 
were the following breathing frequency scores of subjects 18 months after rehabilitation: 


56. 


Group Group 
1 2 3 1 2 3 
12 16 24 12 16 24 
16 14 16 12 12 14 
16 12 18 14 12 15 
14 12 18 16 12 16 
12 18 24 12 12 16 
12 12 24 12 15 18 
12 10 18 20 16 


Source: Data provided courtesy of Dr. Jaap H. Strijbos. 


Seven healthy males (mean age 27.4 years with a standard deviation of 4.4) participated in a study by 
Lambert et al. (A-59), who measured intestinal absorption following oral ingestion and intestinal 
perfusion of a fluid. As part of the study the researchers recorded the following percent changes in 
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plasma volume at six points during 85 minutes of cycle exercise in the drinking and infusion 


experiments: 
Subject 1 2 3 
1 —8.4151514 —7.4902674 —8.02277330 
2 —12.1966790 —5.1496679 —10.46486300 
3 —9.7418719 —5.9062747 —7.06516950 
Drinking 4 —15.0291920 —14.4165470 —16.61268200 
5 —5.8845683 —5.8845683 —3.57781750 
6 —9.7100000 —7.5700000 —3.52995560 
7 —6.9787024 —6.5752716 —5.07020210 
1 —13.5391010 —11.7186910 —10.77312900 
2 —8.8259516 —8.9029745 —6.38160030 
3 —4.2410016 —1.3448910 —2.49740390 
Infusion 4 —10.7192870 —9.7651132 —11.12140900 
5 —6.9487760 —2.9830660 1.77828157 
6 —7.1160660 —5.4111706 —7.07086340 
7 —7.0497788 —5.7725485 —5.18045500 
Subject 4 5 6 
1 —7.35202650 —7.89172340 —7.84726700 
2 —8.40517240 —9.02789810 5.13333985 
3 —4.19974130 —3.33795970 —5.65380700 
Drinking 4 —15.36239700 —17.63314100 —14.43982000 
5 —5.50433470 —5.12242600 —6.26313790 
6 —4.22938570 —7.86923080 —7.51168220 
7 —5.94416340 —5.21535350 —6.34285620 
1 —11.64145400 —12.40814000 —8.26411320 
2 —5.69396590 —6.38160030 —7.37350920 
3 —1.01234570 —5.58572150 —2.81811090 
Infusion 4 —12.13053100 —15.98360700 —12.64667500 
5 2.28844839 2.59034233 1.56622058 
6 —8.35430040 —10.60663700 —9.45689580 
7 —7.92841880 —8.38462720 —8.44542770 


Source: Data provided courtesy of Dr. C. V. Gisolfi. 


Roemer et al. (A-60) developed a self-report measure of generalized anxiety disorder 
(GAD) for use with undergraduate populations. In reliability studies the undergraduate 
subjects completed the GAD questionnaire (GAD-Q) as well as the Penn State Worry 
Questionnaire (PSWQ). The following are the PSWQ scores made by four groups of 
subjects determined by their GAD status: GAD by questionnaire, Study II (group 1); non- 
GAD by questionnaire, Study II (group 2); GAD by questionnaire, Study I (group 3); and 


clinical GAD (group 4). 
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Group 
1 2 3 4 

59.0 50.0 46.0 65.0 65.0 
51.0 28.0 77.0 62.0 66.0 
58.0 43.0 80.0 76.0 69.0 
61.0 36.0 60.0 66.0 73.0 
64.0 36.0 59.0 78.0 67.0 
68.0 30.0 56.0 76.0 78.0 
64.0 24.0 44.0 74.0 76.0 
67.0 39.0 71.0 73.0 66.0 
56.0 29.0 54.0 61.0 55.0 
78.0 48.0 64.0 63.0 59.0 
48.0 36.0 66.0 75.0 44.0 
62.0 38.0 59.0 63.0 68.0 
77.0 42.0 68.0 55.0 64.0 
72.0 26.0 59.0 67.5 41.0 
59.0 35.0 61.0 70.0 54.0 

32.0 78.0 70.0 72.0 

43.0 70.0 55.0 74.0 

55.0 74.0 73.0 59.0 

42.0 73.0 80.0 63.0 

37.0 79.0 51.0 

36.0 79.0 72.0 

41.0 61.0 63.0 

36.0 61.0 58.0 

34.0 72.0 71.0 

42.0 67.0 

35.0 74.0 

51.0 65.0 

37.0 68.0 

50.0 72.0 

39.0 75.0 


56.0 


Source: Data provided courtesy of Dr. T. D. Borkovec. 


Noting that non-Hodgkin's lymphomas (NHL) represent a heterogeneous group of diseases in which 
prognosis is difficult to predict, Christiansen et al. (A-61) report on the prognostic aspects of soluble 
intercellular adhesion molecule-1 (SICAM-1) in NHL. Among the data collected were the following 
serum sICAM-1 (ng/ml) levels in four groups of subjects: healthy controls (C), high-grade NHL 
(hNHL), low-grade NHL (1NHL), and patients with hairy cell leukemia (HCL). 


C hNHL INHL HCL 
309 460 844 824 961 581 382 
329 222 503 496 1097 601 975 
314 663 764 656 1099 572 663 
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226 
309 
382 
325 


543 
352 
443 
359 
383 
587 
648 
782 
472 
506 
663 
873 
987 
859 
1193 
1836 
691 


hNHL 


1088 
470 
806 
482 
734 
616 
836 

1187 
581 
381 
699 

1854 
769 
510 
571 

1248 
784 
514 
678 

1264 
618 

1123 
912 
520 

1867 
485 
287 
455 
522 


1038 
1050 
446 
1218 
511 
317 
334 
1026 
534 
292 
782 
1136 
476 


625 
473 
654 
508 
454 
889 
805 
541 
655 
654 

1859 
619 

1837 
534 
424 
571 
420 
408 
391 
493 

1162 
460 

1113 
572 
653 

1340 
656 


439 
1135 
590 
404 
382 
692 
484 
438 
787 
71 
478 
602 
802 
568 
665 


HCL 


429 
1902 
1842 

314 

430 

645 

637 

712 

581 

860 

448 

735 


Source: Data provided courtesy of Dr. Ilse Christiansen. 


Cossette et al. (A-62) examined gender and kinship with regard to caregivers’ use of informal and 
formal support and to two models of support. Among the data collected were the following ages of 
three groups of caregivers of a demented relative living at home: husbands, wives, and adult 


daughters. 

Husband Wife Daughter 
64 66 73 59 67 40 50 
70 58 71 66 67 47 58 
55 81 70 80 57 46 46 
67 77 71 76 53 45 47 
79 76 56 68 50 69 50 
67 64 68 53 70 48 53 
77 82 76 78 70 53 57 
68 85 67 75 50 65 
72 63 66 74 47 50 


(Continued) 
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Husband Wife Daughter 
67 72 67 86 62 43 
77 77 72 63 55 59 
70 79 72 52 49 44 
65 63 70 55 43 45 
65 80 66 71 44 41 
74 70 73 67 47 50 
86 85 78 78 57 58 
72 76 64 70 49 35 
71 67 78 68 50 
78 72 59 78 59 
71 60 71 59 45 
88 74 70 72 50 
TI 65 67 73 48 
75 53 78 75 51 
66 70 67 54 46 
80 72 55 65 62 
76 74 64 67 55 
67 79 69 83 50 
65 63 59 70 43 
62 77 55 72 39 
82 78 75 71 50 
75 69 68 76 50 
80 65 74 43 
74 81 68 28 
70 79 69 

75 72 


Source: Data provided courtesy of Sylvie Cossette, M.Sc., R.N. 


Tasaka et al. (A-63) note that Corynebacterium parvum (CP) increases susceptibility to endotoxin, 
which is associated with increased production of tumor necrosis factor (TNF). They investigated the 
effect of CP-priming on the pathogenesis of acute lung injury caused by intratracheal Escherichia 
coli endotoxin (lipopolysaccharide [LPS]). Experimental animals consisted of female guinea pigs 
divided into four groups. Animals in two groups received a 4-mg/kg treatment of CP 7 days before the 
study. Subsequently, nonpretreated animals received either saline alone (Control) or endotoxin (LPS- 
alone). The pretreated groups received either saline (CP-alone) or LPS (CP + LPS). Among the 
data collected were the following values of lung tissue-to-plasma ratio of radio-iodized serum 
albumin assay: 


Control CP-alone LPS-alone CP + LPS 


0.12503532 0.18191647 0.17669093 0.3651166 

0.10862729 0.30887462 0.25344761 0.64062964 
0.10552931 0.25011885 0.17372285 0.39208734 
0.15587316 0.23858085 0.1786867 0.49942059 
0.13672624 0.26558231 0.22209666 0.85718475 
0.11290446 0.32298454 0.27064831 0.93030465 


Source: Data provided courtesy of Dr. Sadatomo Tasaka. 
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According to Takahashi et al. (A-64) research indicates that there is an association between 
alterations in calcium metabolism and various bone diseases in patients with other disabilities. 
Using subjects with severe mental retardation (mean age 16 years) who had been living in institutions 
for most of their lives, Takahashi et al. examined the relationship between bone change and other 
variables. Subjects were divided into groups on the basis of severity of bone change. Among the data 
collected were the following serum alkaline phosphatase (IU/L) values: 


Grade I: 109, 86, 79, 103, 47, 105, 188, 96, 249 
Grade II: 86, 106, 164, 146, 111, 263, 162, 111 


Grade III: 283, 201, 208, 301, 135, 192, 135, 83, 193, 175, 174, 193, 224, 
192, 233 


Source: Data provided courtesy of Dr. Mitsugi Takahashi. 


Research indicates that dietary copper deficiency reduces growth rate in rats. In a related study, Allen 
(A-65) assigned weanling male Sprague-Dawley rats to one of three food groups: copper-deficient 
(CuD), copper-adequate (CuA), and pair-fed (PF). Rats in the PF group were initially weight- 
matched to rats of the CuD group and then fed the same weight of the CuA diet as that consumed by 
their CuD counterparts. After 20 weeks, the rats were anesthetized, blood samples were drawn, and 
organs were harvested. As part of the study the following data were collected: 


Body Heart Liver Kidney Spleen 
weight weight weight weight weight 
Rat Diet (BW)(g) (HW)(g) (LW)(g) (KW)(g) (SW)(g) 
1 253.66 0.89 2.82 1.49 0.41 
2 400.93 1.41 3.98 2.15 0.76 
3 CuD 355.89 1.24 5.15 2.27 0.69 
4 404.70 2.18 4.77 2.99 0.76 
6 397.28 0.99 2.34 1.84 0.50 
7 421.88 1.20 3.26 2.32 0.79 
8 PF 386.87 0.88 3.05 1.86 0.84 
9 401.74 1.02 2.80 2.06 0.76 
10 437.56 1.22 3.94 2.25 0.75 
11 490.56 1.21 4.51 2.30 0.78 
12 528.51 1.34 4.38 2.75 0.76 
13 CuA 485.51 1.36 4.40 2.46 0.82 
14 509.50 1.27 4.67 2.50 0.79 
15 489.62 1.31 5.83 2.74 0.81 
HW/BW LW/BW KW/BW SW/BW Ceruloplasmin 
Rat Diet (g/100 g) (g/100 g) (g/100 g) (2/100 g) (mg/dl) 
1 0.00351 0.01112 0.00587 0.00162 nd 
2 0.00352 0.00993 0.00536 0.00190 5:27 
3 CuD 0.00348 0.01447 0.00638 0.00194 4.80 
4 0.00539 0.01179 0.00739 0.00188 4.97 


(Continued) 


REVIEW QUESTIONS AND EXERCISES 405 


HW/BW LW/BW KW/BW SW/BW Ceruloplasmin 


Rat Diet (g/100 g) (g/100 g) (g/100 g) (g/100 g) (mg/dl) 
6 0.00249 0.00589 0.00463 0.00126 35.30 
7 0.00284 0.00773 0.00550 0.00187 39.00 
8 PF 0.00227 0.00788 0.00481 0.00217 28.00 
9 0.00254 0.00697 0.00513 0.00189 34.20 

10 0.00279 0.00900 0.00514 0.00171 45.20 

11 0.00247 0.00919 0.00469 0.00159 34.60 

12 0.00254 0.00829 0.00520 0.00144 39.00 

13 CuA 0.00280 0.00906 0.00507 0.00169 37.10 

14 0.00249 0.00917 0.00491 0.00155 33.40 

15 0.00268 0.01191 0.00560 0.00165 37.30 

nd, no data. 


Source: Data provided courtesy of Corrie B. Allen. 


Hughes et al. (A-66) point out that systemic complications in acute pancreatitis are largely responsible 
for mortality associated with the disease. They note further that proinflammatory cytokines, particularly 
TNFo, may play a central role in acute pancreatitis by mediating the systemic sequelae. In their research 
they used a bile-infusion model of acute pancreatitis to show amelioration of disease severity as well as 
an improvement in overall survival by TNFo inhibition. Experimental material consisted of adult male 
Sprague-Dawley rats weighing between 250 and 300 grams divided into three groups: untreated (bile 
solution infused without treatment); treated (bile solution infused preceded by treatment with 
polyclonal anti — TNFa antibody); and sham (saline infused). Among the data collected were the 
following hematocrit (%) values for animals surviving more than 48 hours: 


Sham Untreated Treated 
38 56 40 
40 60 42 
32 50 38 
36 50 46 
40 50 36 
40 35 
38 40 
40 40 
38 55 
40 35 
36 
40 
40 
35 
45 


Source: Data provided courtesy of 
Dr. A. Osama Gaber. 


A study by Smárason et al. (A-67) was motivated by the observations of other researchers that sera 
from pre-eclamptic women damaged cultured human endothelial cells. Subjects for the present study 
were women with pre-eclampsia, matched control women with normal pregnancies, and nonpregnant 
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women of childbearing age. Among the data collected were the following observations on a relevant 
variable measured on subjects in the three groups. 


Pre-Eclampsia Pregnant Controls Nonpregnant Controls 
113.5 91.4 94.5 
106.6 95.6 115.9 
39.1 113.1 107.2 
95.5 100.8 103.2 
43.5 88.2 104.7 
49.2 92.2 94.9 
99.5 78.6 93.0 
102.9 96.9 100.4 
101.2 91.6 107.1 
104.9 108.6 105.5 
75.4 77.3 119.3 
71.1 100.0 88.2 
73.9 61.7 82.2 
76.0 83.3 125.0 
81.3 103.6 126.1 
72.7 92.3 129.1 
75.3 98.6 106.9 
55.2 85.0 110.0 
90.5 128.2 127.3 
55.8 88.3 128.6 


Source: Data provided courtesy of Dr. Alexander Smárason. 


The objective of a study by LeRoith et al. (A-68) was to evaluate the effect of a 7-week administration 
of recombinant human GH (rhGH) and recombinant human insulin-like growth factor (rhIGF-I) 
separately and in combination on immune function in elderly female rhesus monkeys. The assay for 
the in vivo function of the immune system relied on the response to an immunization with tetanus 
toxoid. The following are the responses for the three treatment groups and a control group: 


Saline rhIGF-I rhGH rhIGF-I + rhGH 


11.2 12.2 12.15 11.5 
9.0 9.4 11.20 12.4 
10.8 10.7 10.60 10.8 
10.0 10.8 11.30 11.9 
9.1 11.00 11.0 

12.6 


Source: Data provided courtesy of Dr. Jack A. Yanowski. 


Hampl et al. (A-69) note that inhaled nitric oxide (NO) is a selective pulmonary vasodilator. They 
hypothesized that a nebulized diethylenetriamine/NO (DETA/NO) would stay in the lower airways 
and continuously supply sufficient NO to achieve sustained vasodilation in chronic pulmonary 
hypertension. Experimental material consisted of adult, male, specific pathogen-free Sprague- 
Dawley rats randomly divided into four groups: untreated, pulmonary normotensive controls; 
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monocrotaline-injected (to induce hypertension) with no treatment (MCT); monocrotaline-injected 
treated with either a 5 — umol dose or a 50 — ¡mol dose of DETA/NO. Nineteen days after inducing 
pulmonary hypertension in the two groups of rats, the researchers began the treatment procedure, 
which lasted for 4 days. They collected, among other data, the following measurements on cardiac 
output for the animals in the four groups: 


MCT + DETA/NO 
Control MCT Sumol 50umol 
71.8 42.8 72.5 47.1 
66.1 53.2 62.9 86.6 
67.6 56.1 58.9 56.0 
66.4 56.5 69.3 


Source: Data provided courtesy of Dr. Stephen L. Archer. 


Exercises for Use with Large Data Sets Available on the Following Website: 
www.wiley.com/college/daniel 


1. In Kreiter et al. (A-70) medical school exams were delivered via computer format. Because there 
were not enough computer stations to test the entire class simultaneously, the exams were 
administered over 2 days. Both students and faculty wondered if students testing on day 2 might 
have an advantage due to extra study time or a breach in test security. Thus, the researchers 
examined a large medical class (n — 193) tested over 2 days with three 2-hour 80-item multiple- 
choice exams. Students were assigned testing days via pseudorandom assignment. Of interest was 
whether taking a particular exam on day 1 or day 2 had a significant impact on scores. Use the 
data set MEDSCORES to determine if test, day, or interaction has significant impact on test 
scores. Let a = .05. 


2. Referto the serum lipid-bound sialic acid data on 1400 subjects (LSADATA). We wish to conduct 
a study to determine if the measurement of serum lipid-bound sialic acid (LSA) might be of use in 
the detection of breast cancer. The LSA measurements (mg/dl) are for four populations of 
subjects: normal controls, A; patients with benign breast disease, B; patients with primary breast 
cancer, C; and patients with recurrent metastatic breast cancer, D. Select a simple random sample 
of size 10 from each population and perform an appropriate analysis to determine if we may 
conclude that the four population means are different. Let a = .05 and determine the p value. Test 
all possible pairs of sample means for significance. What conclusions can one draw from the 
analysis? Prepare a verbal report of the findings. Compare your results with those of your 
classmates. 


3. Refer to the serum angiotensin-converting enzyme data on 1600 subjects (SACEDATA). 
Sarcoidosis, found throughout the world, is a systemic granulomatous disease of unknown 
cause. The assay of serum angiotensin-converting enzyme (SACE) is helpful in the diagnosis of 
active sarcoidosis. The activity of SACE is usually increased in patients with the disease, while 
normal levels occur in subjects who have not had the disease, those who have recovered, and 
patients with other granulomatous disorders. The data are the SACE values for four populations 
of subjects classified according to status regarding sarcoidosis: never had, A; active, B; stable, C; 
recovered, D. Select a simple random sample of 15 subjects from each population and perform an 
analysis to determine if you can conclude that the population means are different. Let a = .05. 
Use Tukey's test to test for significant differences among individual pairs of means. Prepare a 
written report on your findings. Compare your results with those of your classmates. 
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4. Referto the urinary colony-stimulating factor data on 1500 subjects (CSFDATA). The data are the 
urinary colony-stimulating factor (CSF) levels in five populations: normal subjects and subjects 
with four different diseases. Each observation represents the mean colony count of four plates from a 
single urine specimen from a given subject. Select a simple random sample of size 15 from each of 
the five populations and perform an analysis of variance to determine if one may conclude that the 
population means are different. Let о = .05. Use Tukey's HSD statistic to test for significant 
differences among all possible pairs of sample means. Prepare a narrative report on the results of 
your analysis. Compare your results with those of your classmates. 


5. Refer to the red blood cell data on 1050 subjects (RBCDATA). Suppose that you are a 
statistical consultant to a medical researcher who is interested in learning something about the 
relationship between blood folate concentrations in adult females and the quality of their diet. 
The researcher has available three populations of subjects: those whose diet quality is rated as 
good, those whose diets are fair, and those with poor diets. For each subject there is also 
available her red blood cell (RBC) folate value (in g/liter of red cells). Draw a simple random 
sample of size 10 from each population and determine whether the researcher can conclude 
that the three populations differ with respect to mean RBC folate value. Use Tukey's test to 
make all possible comparisons. Let о = .05 and find the p value for each test. Compare your 
results with those of your classmates. 

6. Refer to the serum cholesterol data on 350 subjects under three diet regimens (SERUMCHO). 
A total of 347 adult males between the ages of 30 and 65 participated in a study to investigate 
the relationship between the consumption of meat and serum cholesterol levels. Each subject 
ate beef as his only meat for a period of 20 weeks, pork as his only meat for another period of 
20 weeks, and chicken or fish as his only meat for another 20-week period. At the end of each 
period serum cholesterol determinations (mg/100ml) were made on each subject. Select a 
simple random sample of 10 subjects from the population of 350. Use two-way analysis of 
variance to determine whether one should conclude that there is a difference in population 
mean serum cholesterol levels among the three diets. Let а = .05. Compare your results with 
those of your classmates. 
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CHAPTER 9 


SIMPLE LINEAR REGRESSION 
AND CORRELATION 


CHAPTER OVERVIEW 


This chapter provides an introduction and overview of two common techniques 
for exploring the strength of the relationship between two variables. The first 
technique, linear regression, will help us find an objective way to predict or 
estimate the value of one variable given a value of another variable. The second 
technique, correlation, will help us find an objective measure ofthe strength of 
the relationship between two variables. 


TOPICS 


9.1 INTRODUCTION 

9.2 THE REGRESSION MODEL 

9.3 THE SAMPLE REGRESSION EQUATION 

9.4 EVALUATING THE REGRESSION EQUATION 
9.5 USING THE REGRESSION EQUATION 

9.6 THE CORRELATION MODEL 

9.7 THE CORRELATION COEFFICIENT 

9.8 SOME PRECAUTIONS 

9.9 SUMMARY 


LEARNING OUTCOMES 


After studying this chapter, the student will 
1. beable to obtain a simple linear regression model and use it to make predictions. 


2. be able to calculate the coefficient of determination and to interpret tests of 
regression coefficients. 


3. be able to calculate correlations among variables. 


4. understand how regression and correlation differ and when the use of each is 
appropriate. 
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9.1 


INTRODUCTION 


In analyzing data for the health sciences disciplines, we find that it is frequently desirable to 
learn something about the relationship between two numeric variables. We may, for example, 
be interested in studying the relationship between blood pressure and age, height and weight, 
the concentration of an injected drug and heart rate, the consumption level of some nutrient 
and weight gain, the intensity of a stimulus and reaction time, or total family income and 
medical care expenditures. The nature and strength of the relationships between variables 
such as these may be examined using linear models such as regression and correlation 
analysis, two statistical techniques that, although related, serve different purposes. 


Regression Regression analysis is helpful in assessing specific forms of the relation- 
ship between variables, and the ultimate objective when this method of analysis is employed 
usually is to predict or estimate the value of one variable corresponding to a given value of 
another variable. The ideas of regression were first elucidated by the English scientist Sir 
Francis Galton (1822-1911) in reports of his research on heredity—first in sweet peas and 
later in human stature. He described a tendency of adult offspring, having either short or tall 
parents, to revert back toward the average height of the general population. He first used the 
word reversion, and later regression, to refer to this phenomenon. 


Correlation Correlation analysis, on the other hand, is concerned with measuring 
the strength of the relationship between variables. When we compute measures of 
correlation from a set of data, we are interested in the degree of the correlation between 
variables. Again, the concepts and terminology of correlation analysis originated with 
Galton, who first used the word correlation in 1888. 

In this chapter our discussion is limited to the exploration of the linear relationship 
between two variables. The concepts and methods of regression are covered first, 
beginning in the next section. In Section 9.6 the ideas and techniques of correlation 
are introduced. In the next chapter we consider the case where there is an interest in the 
relationships among three or more variables. 

Regression and correlation analysis are areas in which the speed and accuracy of a 
computer are most appreciated. The data for the exercises of this chapter, therefore, are 
presented in a way that makes them suitable for computer processing. As is always the case, 
the input requirements and output features of the particular programs and software 
packages to be used should be studied carefully. 


9.2 THE REGRESSION MODEL 


In the typical regression problem, as in most problems in applied statistics, researchers have 
available for analysis a sample of observations from some real or hypothetical population. 
Based on the results of their analysis of the sample data, they are interested in reaching 
decisions about the population from which the sample is presumed to have been drawn. It is 
important, therefore, that the researchers understand the nature of the population in which 
they are interested. They should know enough about the population to be able either to 
construct a mathematical model for its representation or to determine if it reasonably fits 
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some established model. A researcher about to analyze a set of data by the methods of simple 
linear regression, for example, should be secure in the knowledge that the simple linear 
regression model is, at least, an approximate representation of the population. It is unlikely 
that the model will be a perfect portrait of the real situation, since this characteristic is seldom 
found in models of practical value. A model constructed so that it corresponds precisely with 
the details of the situation is usually too complex to yield any information of value. On the 
other hand, the results obtained from the analysis of data that have been forced into a model 
that does not fit are also worthless. Fortunately, however, a perfectly fitting model is not a 
requirement for obtaining useful results. Researchers, then, should be able to distinguish 
between the occasion when their chosen models and the data are sufficiently compatible for 
them to proceed and the case where their chosen model must be abandoned. 


Assumptions Underlying Simple Linear Regression In the simple 
linear regression model two variables, usually labeled X and Y, are of interest. The letter X is 
usually used to designate a variable referred to as the independent variable, since 
frequently it is controlled by the investigator; that is, values of X may be selected by 
the investigator and, corresponding to each preselected value of X, one or more values of 
another variable, labeled Y, are obtained. The variable, Y, accordingly, is called the 
dependent variable, and we speak of the regression of Y on X. The following are the 
assumptions underlying the simple linear regression model. 


1. Values of the independent variable X are said to be "fixed." This means that the 
values of X are preselected by the investigator so that in the collection of the data they 
are not allowed to vary from these preselected values. In this model, X is referred to 
by some writers as a nonrandom variable and by others as a mathematical variable. It 
should be pointed out at this time that the statement of this assumption classifies our 
model as the classical regression model. Regression analysis also can be carried out 
on data in which X is a random variable. 


2. The variable X is measured without error. Since no measuring procedure is perfect, 
this means that the magnitude of the measurement error in X is negligible. 


3. For each value of X there is a subpopulation of Y values. For the usual inferential 
procedures of estimation and hypothesis testing to be valid, these subpopulations 
must be normally distributed. In order that these procedures may be presented it will 
be assumed that the Y values are normally distributed in the examples and exercises 
that follow. 


4. The variances of the subpopulations of Y are all equal and denoted by o?. 


5. The means of the subpopulations of Yall lie on the same straight line. This is known 
as the assumption of linearity. This assumption may be expressed symbolically as 


Hy = Bo + Bix (9.2.1) 


where My is the mean of the subpopulation of Y values for a particular value of X, 
and Во and В; are called the population regression coefficients. Geometrically, Ву and 
P, represent the y-intercept and slope, respectively, of the line on which all of the 
means are assumed to lie. 
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6. The Y values are statistically independent. In other words, in drawing the sample, it is 
assumed that the values of Y chosen at one value of X in no way depend on the values 
of Y chosen at another value of X. 


These assumptions may be summarized by means of the following equation, which is 
called the simple linear regression model: 


у = Bot Вх в (9.2.2) 


where y is a typical value from one of the subpopulations of Y, Ву and f, are as defined for 
Equation 9.2.1, and e is called the error term. If we solve 9.2.2 for e, we have 


€ = y — (Bo + Вх) (9.2.3) 
= Yy — Myx 

and we see that e shows the amount by which y deviates from the mean of the subpopulation 
of Y values from which it is drawn. As a consequence of the assumption that the 
subpopulations of Y values are normally distributed with equal variances, the e's for 
each subpopulation are normally distributed with a variance equal to the common variance 
of the subpopulations of Y values. 

The following acronym will help the reader remember most of the assumptions 
necessary for inference in linear regression analysis: 


LINE [Linear (assumption 5), Independent (assumption 6), Normal (assumption 3), Equal 
variances (assumption 4)] 


A graphical representation of the regression model is given in Figure 9.2.1. 


АХ, У) 


Hy |x4 


FIGURE 9.2.1 Representation of the simple linear regression model. 
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9.3 THE SAMPLE REGRESSION EQUATION 


In simple linear regression the object of the researcher's interest is the population 
regression equation—the equation that describes the true relationship between the 
dependent variable Y and the independent variable X. The variable designated by Y is 
sometimes called the response variable and X is sometimes called the predictor variable. 

In an effort to reach a decision regarding the likely form of this relationship, the 
researcher draws a sample from the population of interest and using the resulting data, 
computes a sample regression equation that forms the basis for reaching conclusions 
regarding the unknown population regression equation. 


Steps in Regression Analysis In the absence of extensive information 
regarding the nature of the variables of interest, a frequently employed strategy is to 
assume initially that they are linearly related. Subsequent analysis, then, involves the 
following steps. 


1. Determine whether or not the assumptions underlying a linear relationship are met in 
the data available for analysis. 


2. Obtain the equation for the line that best fits the sample data. 


3. Evaluate the equation to obtain some idea of the strength of the relationship and the 
usefulness of the equation for predicting and estimating. 


4. If the data appear to conform satisfactorily to the linear model, use the equation 
obtained from the sample data to predict and to estimate. 


When we use the regression equation to predict, we will be predicting the value Y is 
likely to have when X has a given value. When we use the equation to estimate, we will be 
estimating the mean of the subpopulation of Y values assumed to exist at a given value of X. 
Note that the sample data used to obtain the regression equation consist of known values of 
both X and Y. When the equation is used to predict and to estimate Y, only the corresponding 
values of X will be known. We illustrate the steps involved in simple linear regression 
analysis by means of the following example. 


EXAMPLE 9.3.1 


Després et al. (A-1) point out that the topography of adipose tissue (AT) is associated with 
metabolic complications considered as risk factors for cardiovascular disease. It is 
important, they state, to measure the amount of intraabdominal AT as part of the evaluation 
of the cardiovascular-disease risk of an individual. Computed tomography (CT), the only 
available technique that precisely and reliably measures the amount of deep abdominal AT, 
however, is costly and requires irradiation of the subject. In addition, the technique is not 
available to many physicians. Després and his colleagues conducted a study to develop 
equations to predict the amount of deep abdominal AT from simple anthropometric 
measurements. Their subjects were men between the ages of 18 and 42 years who 
were free from metabolic disease that would require treatment. Among the measurements 
taken on each subject were deep abdominal AT obtained by CT and waist circumference as 
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shown in Table 9.3.1. A question of interest is how well one can predict and estimate deep 
abdominal AT from knowledge of the waist circumference. This question is typical of those 
that can be answered by means of regression analysis. Since deep abdominal AT is the 
variable about which we wish to make predictions and estimations, it is the dependent 
variable. The variable waist measurement, knowledge of which will be used to make the 
predictions and estimations, is the independent variable. 


TABLE 9.3.1 Waist Circumference (cm), X, and Deep Abdominal AT, Y, of 109 Men 


Subject X Y Subject X Y Subject X Y 
1 74.75 25.72 38 103.00 129.00 75 108.00 217.00 
2 72.60 25.89 39 80.00 74.02 76 100.00 140.00 
3 81.80 42.60 40 79.00 55.48 77 103.00 109.00 
4 83.95 42.80 41 83.50 73.13 78 104.00 127.00 
5 74.65 29.84 42 76.00 50.50 79 106.00 112.00 
6 71.85 21.68 43 80.50 50.88 80 109.00 192.00 
7 80.90 29.08 44 86.50 140.00 81 103.50 132.00 
8 83.40 32.98 45 83.00 96.54 82 110.00 126.00 
9 63.50 11.44 46 107.10 118.00 83 110.00 153.00 
10 73.20 32.22 47 94.30 107.00 84 112.00 158.00 
11 71.90 28.32 48 94.50 123.00 85 108.50 183.00 
12 75.00 43.86 49 79.70 65.92 86 104.00 184.00 
13 73.10 38.21 50 79.30 81.29 87 111.00 121.00 
14 79.00 42.48 51 89.80 111.00 88 108.50 159.00 
15 77.00 30.96 52 83.80 90.73 89 121.00 245.00 
16 68.85 55.78 53 85.20 133.00 90 109.00 137.00 
17 75.95 43.78 54 75.50 41.90 91 97.50 165.00 
18 74.15 33.41 55 78.40 41.71 92 105.50 152.00 
19 73.80 43.35 56 78.60 58.16 93 98.00 181.00 
20 75.90 29.31 57 87.80 88.85 94 94.50 80.95 
21 76.85 36.60 58 86.30 155.00 95 97.00 137.00 
22 80.90 40.25 59 85.50 70.77 96 105.00 125.00 
23 79.90 35.43 60 83.70 75.08 97 106.00 241.00 
24 89.20 60.09 61 77.60 57.05 98 99.00 134.00 
25 82.00 45.84 62 84.90 99.73 99 91.00 150.00 
26 92.00 70.40 63 79.80 27.96 100 102.50 198.00 
27 86.60 83.45 64 108.30 123.00 101 106.00 151.00 
28 80.50 84.30 65 119.60 90.41 102 109.10 229.00 
29 86.00 78.89 66 119.90 106.00 103 115.00 253.00 
30 82.50 64.75 67 96.50 144.00 104 101.00 188.00 
31 83.50 72.56 68 105.50 121.00 105 100.10 124.00 
32 88.10 89.31 69 105.00 97.13 106 93.30 62.20 
33 90.80 78.94 70 107.00 166.00 107 101.80 133.00 
34 89.40 83.55 71 107.00 87.99 108 107.90 208.00 
35 102.00 127.00 72 101.00 154.00 109 108.50 208.00 
36 94.50 121.00 73 97.00 100.00 
37 91.00 107.00 74 100.00 123.00 


Source: Data provided courtesy of Jean-Pierre Després, Ph.D. 
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The Scatter Diagram 


A first step that is usually useful in studying the relationship between two variables is to 
prepare a scatter diagram of the data such as is shown in Figure 9.3.1. The points are 
plotted by assigning values of the independent variable X to the horizontal axis and values 
of the dependent variable Y to the vertical axis. 

The pattern made by the points plotted on the scatter diagram usually suggests the 
basic nature and strength of the relationship between two variables. As we look at 
Figure 9.3.1, for example, the points seem to be scattered around an invisible straight 
line. The scatter diagram also shows that, in general, subjects with large waist circumfer- 
ences also have larger amounts of deep abdominal AT. These impressions suggest that the 
relationship between the two variables may be described by a straight line crossing the Y- 
axis below the origin and making approximately a 45-degree angle with the X-axis. It looks 
as if it would be simple to draw, freehand, through the data points the line that describes the 
relationship between X and У. It is highly unlikely, however, that the lines drawn by any two 
people would be exactly the same. In other words, for every person drawing such a line by 
eye, or freehand, we would expect a slightly different line. The question then arises as to 
which line best describes the relationship between the two variables. We cannot obtain an 
answer to this question by inspecting the lines. In fact, it is not likely that any freehand line 
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FIGURE 9.3.1 Scatter diagram of data shown in Table 9.3.1. 
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drawn through the data will be the line that best describes the relationship between X and Y, 
since freehand lines will reflect any defects of vision or judgment of the person drawing the 
line. Similarly, when judging which of two lines best describes the relationship, subjective 
evaluation is liable to the same deficiencies. 

What is needed for obtaining the desired line is some method that is not fraught with 
these difficulties. 


The Least-Squares Line 


The method commonly employed for obtaining the desired line is known as the method of 
least squares, and the resulting line is called the least-squares line. The reason for calling 
the method by this name will be explained in the discussion that follows. 

We recall from algebra that the general equation for a straight line may be written as 


where y is a value on the vertical axis, x is a value on the horizontal axis, a is the point where 
the line crosses the vertical axis, and b shows the amount by which y changes for each unit 
change in x. We refer to a as the y-intercept and b as the slope of the line. To draw a line 
based on Equation 9.3.1, we need the numerical values of the constants a and b. Given these 
constants, we may substitute various values of x into the equation to obtain corresponding 
values of y. The resulting points may be plotted. Since any two such coordinates determine 
a straight line, we may select any two, locate them on a graph, and connect them to obtain 
the line corresponding to the equation. 


Obtaining the Least-Square Line 


The least-squares regression line equation may be obtained from sample data by simple 
arithmetic calculations that may be carried out by hand using the following equations 


n 


2-90, Y) 


Bi =" 


(9.3.2) 


Bo = y — Bix (9.3.3) 
where x; and y; are the corresponding values of each data point (X, Y), x and y are the 
means of the X and Y sample data values, respectively, and Bo and В, аге the estimates of 
the intercept Ву and slope f, respectively, of the population regression line. Since the 
necessary hand calculations are time consuming, tedious, and subject to error, the 
regression line equation is best obtained through the use of a computer software package. 
Although the typical researcher need not be concerned with the arithmetic involved, the 
interested reader will find them discussed in references listed at the end of this chapter. 

For the data in Table 9.3.1 we obtain the least-squares regression equation by means 
of MINITAB. After entering the X values in Column 1 and the Y values in Column 2 we 
proceed as shown in Figure 9.3.2. 

For now, the only information from the output in Figure 9.3.2 that we are interested in 
is the regression equation. Other information in the output will be discussed later. 


Dialog box: 


Stat » Regression » Regression 
Type y in Response and x in Predictors. 
Click Storage. Check Residuals and Fits. 
Click OK. 


Output: 


Regression Analysis: y versus x 
The regression equation is 
y = -216 + 3.46 x 


Coef 
2215.98 
3.4589 


Stdev 
21.80 
0.2347 


Predictor 
Constant 
x 

s = 33.06 R-sq = 67. 


Analysis of Variance 


SOURCE 
Regression 
Error 
Total 


DF 
1 
107 
108 


SS 
237549 
116982 
354531 


Unusual Observations 
Obs. х у 
58 86 .00 
65 120 .41 
66 120 00 
71 107 99 
97 106 00 
102 109 00 
103 115 00 


Fit 
82.52 
197.70 
198.74 
154.12 
150.66 
161.38 
181.79 


155 

90 
106. 

87. 
241. 
229. 
253. 


R denotes an obs. 


Se 


MTI 
MTI 
SUI 
SUI 
SUI 


t 


R-sq (adj) 
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ssion command: 


Name СЗ = “FITS1' СА = УВІ 
Regress ‘у’ 1 їх"; 

Fits ‘FITS1’; 

Constant; 
Residuals 


‘RESI1’. 


-ratio 
-9.91 
14.74 


66.7 


9. 
© 


М5 


2375 
10 


with a large st. 


49 
93 


Stdev.Fit 
.43 
22:3, 
.29 
ES, 
.58 
ES: 
.28 


Residual 
72.48 
-107.29 
-92.74 
-66.13 
90.34 
67.62 
71.21 


2 
=g 


resid. 
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St.Resid 
.20R 


33R 


.88R 
.02R 
.76R 
.07R 
.19R 


FIGURE 9.3.2 MINITAB procedure and output for obtaining the least-squares regression 
equation from the data in Table 9.3.1. 
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From Figure 9.3.2 we see that the linear equation for the least-squares line that 
describes the relationship between waist circumference and deep abdominal AT may be 
written, then, as 


$ = —216 + 3.46x 


This equation tells us that since Bo is negative, the line crosses the Y-axis below the 
origin, and that since B, the slope, is positive, the line extends from the lower left-hand 
corner of the graph to the upper right-hand corner. We see further that for each unit increase 
in x, y increases by an amount equal to 3.46. The symbol denotes a value of y computed 
from the equation, rather than an observed value of Y. 

By substituting two convenient values of X into Equation 9.3.2, we may obtain the 
necessary coordinates for drawing the line. Suppose, first, we let X — 70 and obtain 


ў = —216 + 3.46(70) = 26.2 
If we let X = 110 we obtain 

ў = —216 + 3.46(110) = 164 
The line, along with the original data, is shown in Figure 9.3.3. 
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FIGURE 9.3.3 Original data and least-squares line for Example 9.3.1. H 
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The Least-Squares Criterion Now that we have obtained what we call the 
"best fit" line for describing the relationship between our two variables, we need to 
determine by what criterion it is considered best. Before the criterion is stated, let us 
examine Figure 9.3.3. We note that generally the least-squares line does not pass through 
the observed points that are plotted on the scatter diagram. In other words, most of the 
observed points deviate from the line by varying amounts. 

The line that we have drawn through the points is best in this sense: 


The sum of the squared vertical deviations of the observed data points (y;) from the least- 
squares line is smaller than the sum of the squared vertical deviations of the data points 
from any other line. 


In other words, if we square the vertical distance from each observed point (y;) to 
the least-squares line and add these squared values for all points, the resulting total will 
be smaller than the similarly computed total for any other line that can be drawn 
through the points. For this reason the line we have drawn is called the least-squares 
line. 


EXERCISES 


9.3.1 


9.3.2 


9.3.3 


Plot each of the following regression equations on graph paper and state whether X and Yare directly 
or inversely related. 


(a) $2 –3 + 2x 
(b) $—3--0.5x 
(c) $ = 10 — 0.75x 


The following scores represent a nurse's assessment (X) and a physician's assessment (Y) of the 
condition of 10 patients at time of admission to a trauma center. 


X: 18 з 18 15 10 12 8 4 7 3 
Y. 23 20 18 16 14 11 10 7 6 4 


(a) Construct a scatter diagram for these data. 


(b) Plot the following regression equations on the scatter diagram and indicate which one you think 
best fits the data. State the reason for your choice. 


(1) $ = 8 + 0.5x 
(2) $ 2 —10 + 2x 
(3) y=1+1x 


For each of the following exercises (a) draw a scatter diagram and (b) obtain the regression equation 
and plot it on the scatter diagram. 


Methadone is often prescribed in the treatment of opioid addiction and chronic pain. Krantz et al. 
(А-2) studied the relationship between dose of methadone and the corrected QT (ОТс) interval for 
17 subjects who developed torsade de pointes (ventricular tachycardia nearly always due to 
medications). QTc is calculated from an electrocardiogram and is measured in mm/sec. A higher 
QTc value indicates a higher risk of cardiovascular mortality. A question of interest is how well 
one can predict and estimate the QTc value from a knowledge of methadone dose. This question is 
typical of those that can be answered by means of regression analysis. Since QTc is the variable 
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9.3.4 


about which we wish to make predictions and estimations, it is the dependent variable. The 
variable methadone dose, knowledge of which will be used to make the predictions and 
estimations, is the independent variable. 


Methadone Dose Methadone Dose 
(mg/day) QTc (mm/sec) (mg/day) QTc (mm/sec) 
1000 600 650 785 
550 625 600 765 
97 560 660 611 
90 585 270 600 
85 590 680 625 
126 500 540 650 
300 700 600 635 
110 570 330 522 
65 540 


Source: Mori J. Krantz, Ilana B. Kutinsky, Alastair D. Roberston, and Philip S. Mehler, 
“Dose-Related Effects of Methadone on QT Prolongation in a Series of Patients with 
Torsade de Pointes," Pharmacotherapy, 23 (2003), 802-805. 


Reiss et al. (A-3) compared point-of-care and standard hospital laboratory assays for monitoring 
patients receiving a single anticoagulant or a regimen consisting of a combination of anticoagulants. 
It is quite common when comparing two measuring techniques, to use regression analysis in which 
one variable is used to predict another. In the present study, the researchers obtained measures of 
international normalized ratio (INR) by assay of capillary and venous blood samples collected from 
90 subjects taking warfarin. INR, used especially when patients are receiving warfarin, measures the 
clotting ability of the blood. Point-of-care testing for INR was conducted with the CoaguChek assay 
product. Hospital testing was done with standard hospital laboratory assays. The authors used the 
hospital assay INR level to predict the CoaguChek INR level. The measurements are given in the 
following table. 


CoaguChek Hospital CoaguChek Hospital CoaguChek Hospital 
(Y) (X) (Y) (X) (Y) (X) 
1.8 1.6 24 1.2 3.1 2.4 
1.6 1.9 2:3 2.3 1.7 1.8 
2.5 2.8 2.0 1.6 1.8 1.6 
1.9 2.4 3.3 3.8 1.9 1.7 
1.3 1.5 1.9 1.6 5.3 4.2 
2.3 1.8 1.8 1.5 1.6 1.6 
1.2 1.3 2.8 1.8 1.6 1.4 
2.3 2.4 2.5 1.5 3.3 3.3 
2.0 2.1 0.8 1.0 1.5 1.5 
1.5 1.5 1.3 12 22 2.8 
2.1 2.4 3.7 1.4 1.1 1.6 
1.5 1.5 2.4 1.6 2.6 2.6 


(Continued ) 


9.3.5 


9.3.6 
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CoaguChek Hospital CoaguChek Hospital CoaguChek Hospital 
(Y) (X) (Y) (X) (Y) (X) 
1.5 13 4.1 32 6.4 5.0 
1.8 2.1 24 1.2 1.5 1.4 
1.0 1.2 2.3 2.3 3.0 2.8 
2.1 1.9 3.1 1.6 2.6 2.3 
1.6 1.6 1.5 1.4 1.2 1.2 
1.7 1.6 3.6 2.1 2.1 1.9 
2.0 1.9 2:5 1.7 1.1 1.1 
1.8 1.6 2.1 1.7 1.0 1.0 
1.3 4.1 1.8 1.2 1.4 1.5 
1.5 1.9 1.5 1.3 1.7 1.3 
3.6 2.1 2.5 1.1 1.2 1.1 
2.4 22 1.5 1.2 2.5 2.4 
22 2.3 1.5 1.1 1.2 1.3 
2.7 2:2 1.6 1.2 2.5 29 
2.9 3.1 1.4 1.4 1.9 1.7 
2.0 2.2 4.0 2.3 1.8 1.7 
1.0 1.2 2.0 1.2 1.2 1.1 
2.4 2.6 2.5 1.5 1.3 1.1 


Source: Data provided courtesy of Curtis E. Haas, Pharm.D. 


Digoxin is a drug often prescribed to treat heart ailments. The purpose of a study by Parker et al. (A-4) 
was to examine the interactions of digoxin with common grapefruit juice. In one experiment, subjects 
took digoxin with water for 2 weeks, followed by a 2-week period during which digoxin was 
withheld. During the next 2 weeks subjects took digoxin with grapefruit juice. For seven subjects, the 
average peak plasma digoxin concentration (Cmax) when taking water is given in the first column of 
the following table. The second column contains the percent change in Cmax concentration when 
subjects were taking the digoxin with grapefruit juice [GFJ (%) change]. Use the Cmax level when 
taking digoxin with water to predict the percent change in Cmax concentration when taking digoxin 
with grapefruit juice. 


Cmax (ngl/ml) with Water Change in Cmax with СЕЈ (40) 
2.34 29.5 
2.46 40.7 
1.87 5.3 
3.09 23.3 
5.59 —45.1 
4.05 —35.3 
6.21 —44.6 
2.34 29.5 


Source: Data provided courtesy of Robert B. Parker, Pharm.D. 


Evans et al. (A-5) examined the effect of velocity on ground reaction forces (GRF) in dogs with 
lameness from a torn cranial cruciate ligament. The dogs were walked and trotted over a force 
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9.3.7 


platform and the GRF recorded (in newtons) during the stance phase. The following table contains 22 
measurements of force expressed as the mean of five force measurements per dog when walking and 
the mean of five force measurements per dog when trotting. Use the GRF value when walking to 
predict the GRF value when trotting. 


GRF-Walk GRF-Trot GRF-Walk GRF-Trot 
31.5 50.8 24.9 30.2 
33.3 43.2 33.6 46.3 
32.3 44.8 30.7 41.8 
28.8 39.5 27.2 324 
38.3 44.0 44.0 65.8 
36.9 60.1 28.2 32.2 
14.6 11.1 24.3 29.5 
27.0 32.3 31.6 38.7 
32.8 41.3 29.9 42.0 
27.4 38.2 34.3 37.6 
31.5 50.8 24.9 30.2 


Source: Data provided courtesy of Richard Evans, Ph.D. 


Glomerular filtration rate (GFR) is the most important parameter of renal function assessed in renal 
transplant recipients. Although inulin clearance is regarded as the gold standard measure of GFR, its 
use in clinical practice is limited. Krieser et al. (A-6) examined the relationship between the inverse of 
Cystatin C (a cationic basic protein measured in mg/L) and inulin GFR as measured by technetium 
radionuclide labeled diethylenetriamine penta-acetic acid) (DTPA GFR) clearance (ml/min/1.73 m°). 
The results of 27 tests are shown in the following table. Use DTPA GFR as the predictor of inverse 
Cystatin C. 


DTPA GFR 1/Cystatin C DTPA GFR 1/Cystatin C 
18 0.213 42 0.485 
21 0.265 42 0.427 
21 0.446 43 0.562 
23 0.203 43 0.463 
27 0.369 48 0.549 
27 0.568 48 0.538 
30 0.382 51 0.571 
32 0.383 55 0.546 
32 0.274 58 0.402 
32 0.424 60 0.592 
36 0.308 62 0.541 
37 0.498 67 0.568 
41 0.398 68 0.800 
88 0.667 


Source: Data provided courtesy of David Krieser, M.D. 
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9.4 EVALUATING THE REGRESSION EQUATION 


Once the regression equation has been obtained it must be evaluated to determine whether 
it adequately describes the relationship between the two variables and whether it can be 
used effectively for prediction and estimation purposes. 


When Но : В; = 0 Is Not Rejected If in the population the relationship 
between X and У is linear, £}, the slope of the line that describes this relationship, will 
be either positive, negative, or zero. If Ву is zero, sample data drawn from the 
population will, in the long run, yield regression equations that are of little or no 
value for prediction and estimation purposes. Furthermore, even though we assume that 
the relationship between X and Y is linear, it may be that the relationship could be 
described better by some nonlinear model. When this is the case, sample data when 
fitted to a linear model will tend to yield results compatible with a population slope of 
zero. Thus, following a test in which the null hypothesis that $, equals zero is not 
rejected, we may conclude (assuming that we have not made a type II error by 
accepting a false null hypothesis) either (1) that although the relationship between X 
and Y may be linear it is not strong enough for X to be of much value in predicting and 
estimating Y, or (2) that the relationship between X and Y is not linear; that is, some 
curvilinear model provides a better fit to the data. Figure 9.4.1 shows the kinds of 
relationships between X and Y in a population that may prevent rejection of the null 
hypothesis that В, = 0. 


When Ho: В. = О Is Rejected Now let us consider the situations in a 
population that may lead to rejection of the null hypothesis that В, = 0. Assuming 
that we do not commit a type I error, rejection of the null hypothesis that В, = 0 may 
be attributed to one of the following conditions in the population: (1) the relationship 
is linear and of sufficient strength to justify the use of sample regression equations to 
predict and estimate Y for given values of X; and (2) there is a good fit of the data to 
a linear model, but some curvilinear model might provide an even better fit. 
Figure 9.4.2 illustrates the two population conditions that may lead to rejection of 
Ho : В! = 0. 

Thus, we see that before using a sample regression equation to predict and 
estimate, it is desirable to test Ho : В, = 0. We may do this either by using analysis 
of variance and the F statistic or by using the f statistic. We will illustrate both methods. 
Before we do this, however, let us see how we may investigate the strength of the 
relationship between X and Y. 


The Coefficient of Determination One way to evaluate the strength of the 
regression equation is to compare the scatter of the points about the regression line with the 
scatter about y, the mean of the sample values of Y. If we take the scatter diagram for 
Example 9.3.1 and draw through the points a line that intersects the Y-axis at y and is 
parallel to the X-axis, we may obtain a visual impression of the relative magnitudes of the 
scatter of the points about this line and the regression line. This has been done in 
Figure 9.4.3. 
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Y 
X 
(a) 
Y 
X 
(b) 


FIGURE 9.4.1 Conditions in a population that may prevent rejection of the null hypothesis 
that 8; = 0. (a) The relationship between Xand Yis linear, but 8; is so close to zero that sample 
data are not likely to yield equations that are useful for predicting Y when X is given. (b) The 
relationship between X and Y is not linear; a curvilinear model provides a better fit to the data; 
sample data are not likely to yield equations that are useful for predicting Y when X is given. 


It appears rather obvious from Figure 9.4.3 that the scatter of the points about the 
regression line is much less than the scatter about the y line. We would not wish, 
however, to decide on this basis alone that the equation is a useful one. The situation may 
not be always this clear-cut, so that an objective measure of some sort would be much 
more desirable. Such an objective measure, called the coefficient of determination, is 
available. 


The Total Deviation Before defining the coefficient of determination, let us 
justify its use by examining the logic behind its computation. We begin by considering the 
point corresponding to any observed value, у;, and by measuring its vertical distance from 
the y line. We call this the total deviation and designate it (y; — y). 


The Explained Deviation If we measure the vertical distance from the 
regression line to the y line, we obtain (ў; — y), which is called the explained deviation, 
since it shows by how much the total deviation is reduced when the regression line is 
fitted to the points. 
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X 


(b) 
FIGURE 9.4.2 Population conditions relative to X and Y that may cause rejection of the 
null hypothesis that £4 =0. (a) The relationship between X and Y is linear and of sufficient 
strength to justify the use of a sample regression equation to predict and estimate Y for 
given values of X. (b) A linear model provides a good fit to the data, but some curvilinear 
model would provide an even better fit. 


Unexplained Deviation Finally, we measure the vertical distance of the 
observed point from the regression line to obtain (у; — $;), which is called the 
unexplained deviation, since it represents the portion of the total deviation not 
"explained" or accounted for by the introduction of the regression line. These three 
quantities are shown for a typical value of Y in Figure 9.4.4. The difference between the 
observed value of Yand the predicted value of Y, (y; — $;), is also referred to as a residual. 
The set of residuals can be used to test the underlying linearity and equal-variances 
assumptions of the regression model described in Section 9.2. This procedure is 
illustrated at the end of this section. 

It is seen, then, that the total deviation for a particular y; is equal to the sum of the 
explained and unexplained deviations. We may write this symbolically as 


(=) = Gi-») + (=) (9.4.1) 


total explained unexplained 
deviation deviation deviation 
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FIGURE 9.4.3 Scatter diagram, sample regression line, and y line for Example 9.3.1. 


If we measure these deviations for each value of y; and $;, square each deviation, and 
add up the squared deviations, we have 


Yo- = 35-9? + 5 - 51)? (9.4.2) 


total explained unexplained 
sum sum sum 
of squares of squares of squares 


These quantities may be considered measures of dispersion or variability. 


Total Sum of Squares The total sum of squares (SST), for example, is a measure 
of the dispersion of the observed values of Y about their mean y; that is, this term is a 
measure of the total variation in the observed values of Y. The reader will recognize this 
term as the numerator of the familiar formula for the sample variance. 


Explained Sum of Squares The explained sum of squares measures the 
amount of the total variability in the observed values of Y that is accounted for by the 
linear relationship between the observed values of X and Y. This quantity is referred to also 
as the sum of squares due to linear regression (SSR). 
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FIGURE 9.4.4  Scatter diagram showing the total, explained, and unexplained deviations 
for a selected value of Y, Example 9.3.1. 


Unexplained Sum of Squares Тһе unexplained sum of squares is a measure 
of the dispersion of the observed Y values about the regression line and is sometimes called 
the error sum of squares, or the residual sum of squares (SSE). It is this quantity that is 
minimized when the least-squares line is obtained. 

We may express the relationship among the three sums of squares values as 


SST — SSR 4- SSE 
The numerical values of these sums of squares for our illustrative example appear in the 
analysis of variance table in Figure 9.3.2. Thus, we see that SST — 354531, SSR — 237549, 
SSE — 116982, and 


35453] — 237549 4- 116982 
35453] — 354531 


Calculating r Itis intuitively appealing to speculate that if a regression equation 
does a good job of describing the relationship between two variables, the explained or 
regression sum of squares should constitute a large proportion of the total sum of 
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squares. It would be of interest, then, to determine the magnitude of this proportion by 
computing the ratio of the explained sum of squares to the total sum of squares. This is 
exactly what is done in evaluating a regression equation based on sample data, and the 
result is called the sample coefficient of determination, r^. That is, 
2 I2 
2. 520і- У) _ SSR 


r = = 


3-3») SST 


In our present example we have, using the sums of squares values from Figure 9.3.2, 


, 237549 
r= =), 
354531 


The sample coefficient of determination measures the closeness of fit of the sample 
regression equation to the observed values of Y. When the quantities (y; — 5;), the vertical 
distances of the observed values of Y from the equations, are small, the unexplained sum of 
squares is small. This leads to a large explained sum of squares that leads, in turn, to a large 
value of r°. This is illustrated in Figure 9.4.5. 

In Figure 9.4.5(a) we see that the observations all lie close to the regression line, and 
we would expect r to be large. In fact, the computed r for these data is .986, indicating that 
about 99 percent of the total variation in the y; is explained by the regression. 

In Figure 9.4.5(b) we illustrate a case in which the y; are widely scattered about 
the regression line, and there we suspect that 7? is small. The computed 7? for the data 
is .403; that is, less than 50 percent of the total variation in the y; is explained by the 
regression. 

The largest value that 1? can assume is 1, a result that occurs when all the variation in 
the y; is explained by the regression. When r? — 1 all the observations fall on the regression 
line. This situation is shown in Figure 9.4.5(c). 

The lower limit of 7? is 0. This result is obtained when the regression line and 
the line drawn through y coincide. In this situation none of the variation in the y; is 
explained by the regression. Figure 9.4.5(d) illustrates a situation in which 1? is close 
to zero. 

When 7? is large, then, the regression has accounted for a large proportion of the total 
variability in the observed values of Y, and we look with favor on the regression equation. 
On the other hand, a small +? which indicates a failure of the regression to account for a 
large proportion of the total variation in the observed values of Y, tends to cast doubt on the 
usefulness of the regression equation for predicting and estimating purposes. We do not, 
however, pass final judgment on the equation until it has been subjected to an objective 
statistical test. 


Testing Ho : В. = O with the FStatistic The following example illustrates 
one method for reaching a conclusion regarding the relationship between X and Y. 


EXAMPLE 9.4.1 


Refer to Example 9.3.1. We wish to know if we can conclude that, in the population from 
which our sample was drawn, X and Y are linearly related. 


Close fit, large r2 
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(b) 


Poor fit, small r2 


(a) 
r—0 
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FIGURE 9.4.5 as a measure of closeness-of-fit of the sample regression line to the sample 


observations. 


Solution: The steps in the hypothesis testing procedure are as follows: 


1. Data. The data were described in the opening statement of Example 


9.3.1. 


2. Assumptions. We presume that the simple linear regression model and 
its underlying assumptions as given in Section 9.2 are applicable. 


3. Hypotheses. 


Ho : Bi =0 
НА : Pi A 0 
.05 


a 
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TABLE 9.4.1 ANOVA Table for Simple Linear Regression 


Source of Variation SS d.f. MS V.R. 
Linear regression SSR 1 MSR = SSR/1 MSR/MSE 
Residual SSE n-2 MSE = SSE/(n-— 2) 

Total SST n-1 


4. 


10. 


Test statistic. The test statistic is V.R. as explained in the discussion that 
follows. 

From the three sums-of-squares terms and their associated degrees 
of freedom the analysis of variance table of Table 9.4.1 may be constructed. 

In general, the degrees of freedom associated with the sum of squares 
due to regression is equal to the number of constants in the regression 
equation minus 1. In the simple linear case we have two estimates, By and 
Ви; hence the degrees of freedom for regression are 2 — 1 = 1. 


. Distribution of test statistic. It can be shown that when the hypothesis 


of no linear relationship between X and Y is true, and when the 
assumptions underlying regression are met, the ratio obtained by 
dividing the regression mean square by the residual mean square is 
distributed as F with 1 and n — 2 degrees of freedom. 


. Decision rule. Reject Но if the computed value of V.R. is equal to or 


greater than the critical value of F. 


. Calculation of test statistic. As shown in Figure 9.3.2, the computed 


value of F is 217.28. 


Statistical decision. Since 217.28 is greater than 3.94, the critical value 
of F (obtained by interpolation) for 1 and 107 degrees of freedom, the 
null hypothesis is rejected. 


Conclusion. We conclude that the linear model provides a good fit to 
the data. 


p value. For this test, since 217.28 > 8.25, we have p < .005. 


Examing Figure 9.3.2, we see that, in fact, p < .001. е 


Estimating the Population Coefficient of Determination Тһе 
sample coefficient of determination provides a point estimate of o? the population 
coefficient of determination. The population coefficient of determination, o? has the 
same function relative to the population as r* has to the sample. It shows what proportion 
of the total population variation in Y is explained by the regression of Y on X. When the 
number of degrees of freedom is small, r is positively biased. That is, г tends to be large. 
An unbiased estimator of p? is provided by 


el 


(9.4.3) 
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Observe that the numerator of the fraction in Equation 9.4.3 is the unexplained mean 
square and the denominator is the total mean square. These quantities appear in the 
analysis of variance table. For our illustrative example we have, using the data from 
Figure 9.3.2, 

2 116982/107 


==. E журт ee и 
і 354531/108 — 00695 


This quantity is labeled R-sq(adj) in Figure 9.3.2 and is reported as 66.7 percent. We see 
that this value is less than 
2 116982 _ 


rr=1- 354531 = = .67004 


We see that the difference in r? and 72 is due to the factor (п — 1)/(n — 2). When п is large, 
this factor will approach 1 and the difference between 7? and 7? will approach zero. 


Testing Ho : В; = О with the t Statistic When the assumptions stated in 
Section 9.2 are met, Bo and Ё, are unbiased point estimators of the corresponding 
parameters Ву and В;. Since, under these assumptions, the subpopulations of Y values 
are normally distributed, we may construct confidence intervals for and test hypotheses 
about Ву and £,. When the assumptions of Section 9.2 hold true, the sampling distributions 
of Bo and Ё, are each normally distributed with means and variances as follows: 


Ha, = Bo (9.4.4) 
o2, yx 
ad cu Ap A = (9.4.5) 
P nY osx) 
из, = В, (9.4.6) 
апа 
2 
O” 
eS o (9.4.7) 


UPS ET 


In Equations 9.4.5 and 9.4.70? " is the unexplained variance of the subpopulations of Y 
values. 

With knowledge of the sampling distributions of Bo and Ё, we may construct 
confidence intervals and test hypotheses relative to В, and В, in the usual manner. 
Inferences regarding o are usually not of interest. On the other hand, as we have seen, a 
great deal of interest centers on inferential procedures with respect to В ¡- The reason for 
this is the fact that В, tells us so much about the form of the relationship between X and Y. 
When X and Yare linearly related a positive Bi indicates that, in general, Y increases as X 
increases, and we say that there is a direct linear relationship between X and Y. A 
negative Ё, indicates that values of Y tend to decrease as values of X increase, and we say 
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(a) (b) 
FIGURE 9.4.6 Scatter diagrams showing (a) direct linear relationship, (b) inverse linear 
relationship, and (c) no linear relationship between X and Y. 


that there is an inverse linear relationship between X and Y. When there is no linear 
relationship between X and Y, В, is equal to zero. These three situations are illustrated in 
Figure 9.4.6. 


The Test Statistic For testing hypotheses about В, the test statistic when Oy is 
known is | 


z —Ё (бов (9.4.8) 
о. 

В, 
where (В), is the hypothesized value of В. The hypothesized value of 8; does not have 
to be zero, but in practice, more often than not, the null hypothesis of interest is that 
В, = 0. 

As a rule озү is unknown. When this is the case, the test statistic is 


Bi - (i)o 
5%, 


t= (9.4.9) 


where 58, is an estimate of 05, and ft is distributed as Student's t with п — 2 degrees of 
freedom. 

If the probability of observing a value as extreme as the value of the test statistic 
computed by Equation 9.4.9 when the null hypothesis is true is less than 0/2 (since we have 
a two-sided test), the null hypothesis is rejected. 


EXAMPLE 9.4.2 
Refer to Example 9.3.1. We wish to know if we can conclude that the slope of the 
population regression line describing the relationship between X and Y is zero. 


Solution: 


1. Data. See Example 9.3.1. 


2. Assumptions. We presume that the simple linear regression model and 
its underlying assumptions are applicable. 
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3. Hypotheses. 


Ho: В = 0 
Ha: В, #0 
а = .05 


4. Test statistic. The test statistic is given by Equation 9.4.9. 


5. Distribution of test statistic. When the assumptions are met and Но is 
true, the test statistic is distributed as Student's t with n — 2 degrees of 
freedom. 


6. Decision rule. Reject Ho if the computed value of t is either greater than 
or equal to 1.9826 or less than or equal to —1.9826. 


7. Calculation of statistic. The output in Figure 9.3.2 shows that 
B, = 3.4589, 55, = 2347, and 
_ 3.4589 — 0 


[mL = 14.74 
2347 


8. Statistical decision. Reject Ho because 14.74 > 1.9826. 


9. Conclusion. We conclude that the slope of the true regression line is not 
zero. 


10. p value. The p value for this test is less than .01, since, when Но is true, 
the probability of getting a value of f as large as or larger than 2.6230 
(obtained by interpolation) is .005, and the probability of getting a value 
of t as small as or smaller than —2.6230 is also .005. Since 14.74 is 
greater than 2.6230, the probability of observing a value of t as large as 
or larger than 14.74 (when the null hypothesis is true) is less than .005. 
We double this value to obtain 2(.005) — .01. 

Either the F statistic or the f statistic may be used for testing 
Но: В, = 0. The value of the variance ratio is equal to the square of 
the value of the + statistic (i.e., 1? = F) and, therefore, both statistics 
lead to the same conclusion. For the current example, we see that 
(14.74? = 217.27, the value obtained by using the F statistic in 
Example 9.4.1. Hence, the corresponding p value will be the same 
for with the f statistic and the f statistic. 

The practical implication of our results is that we can expect to get 
better predictions and estimates of Y if we use the sample regression 
equation than we would get if we ignore the relationship between X and Y. 
The fact that b is positive leads us to believe that P, is positive and that 
the relationship between X and Y is a direct linear relationship. B 


As has already been pointed out, Equation 9.4.9 may be used to test the null hypothesis that 
B, is equal to some value other than 0. The hypothesized value for Вл, (,), is substituted 
into Equation 9.4.9. All other quantities, as well as the computations, are the same as in the 
illustrative example. The degrees of freedom and the method of determining significance 
are also the same. 
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A Confidence Interval for 8, Once we determine that it is unlikely, in light of 
sample evidence, that P, is zero, we may be interested in obtaining an interval estimate 
of В,. The general formula for a confidence interval, 


estimator + (reliability factor) (standard error of the estimate) 


may be used. When obtaining a confidence interval for Ву, the estimator is Bis the 
reliability factor is some value of z or t (depending on whether or not 0. is known), and 
the standard error of the estimator is І 


When o? is unknown, o; is estimated by 


|x 


where 5s — MSE 
In most practical situations our 100(1 — o) percent confidence interval for f is 


Êi taa /25, (9.4.10) 


For our illustrative example we construct the following 95 percent confidence 
interval for f: 


3.4589 + 1.9826(.2347) 
(2.99, 3.92) 


We interpret this interval in the usual manner. From the probabilistic point of view we say 
that in repeated sampling 95 percent of the intervals constructed in this way will include |. 
The practical interpretation is that we are 95 percent confident that the single interval 
constructed includes |. 


Using the Confidence Interval to Test Ho : 84 = О Itis instructive to 
note that the confidence interval we constructed does not include zero, so that zero is not a 
candidate for the parameter being estimated. We feel, then, that it is unlikely that В; = 0. 
This is compatible with the results of our hypothesis test in which we rejected the null 
hypothesis that $, = 0. Actually, we can always test Но: В, = Oat the o significance level 
by constructing the 100(1 — о) percent confidence interval for |, and we can reject ог fail 
to reject the hypothesis on the basis of whether or not the interval includes zero. If the 
interval contains zero, the null hypothesis is not rejected; and if zero is not contained in the 
interval, we reject the null hypothesis. 


Interpreting the Results It must be emphasized that failure to reject the null 
hypothesis that $, = 0 does not mean that X and Y are not related. Not only is it possible 
that a type II error may have been committed but it may be true that X and Yare related in 
some nonlinear manner. On the other hand, when we reject the null hypothesis that 6; = 0, 
we cannot conclude that the true relationship between X апа Y is linear. Again, it may be 
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that although the data fit the linear regression model fairly well (as evidenced by the fact 
that the null hypothesis that $, = 0 is rejected), some nonlinear model would provide ап 
even better fit. Consequently, when we reject Но that В, = 0, the best we can say is that 
more useful results (discussed below) may be obtained by taking into account the 
regression of Y on X than in ignoring it. 


Testing the Regression Assumptions The values of the set of residuals, 
(y; = У ), for a data set are often used to test the linearity and equal-variances 
assumptions (assumptions 4 and 5 of Section 9.2) underlying the regression model. 
This is done by plotting the values of the residuals on the y-axis and the predicted values 
of y on the x-axis. If these plots show a relatively random scatter of points above and 
below a horizontal line at (y; — $;) = 0, these assumptions are assumed to have been met 
for a given set of data. A non-random pattern of points can indicate violation of the 
linearity assumption, and a funnel-shaped pattern of the points can indicate violation of 
the equal-variances assumption. Examples of these patterns are shown in Figure 9.4.7. 


Value of residual 


Value of residual 
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FIGURE 9.4.7 Residual plots useful for testing the linearity and equal-variances assumptions 
of the regression model. (a) A random pattern of points illustrating non-violation of the 
assumptions. (b) A non-random pattern illustrating a likely violation of the linearity assumption. 
(c) A funneling pattern illustrating a likely violation of the equal-variances assumption. 
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FIGURE 9.4.8 Residual plot of data from Example 9.3.1. 


Many computer packages will provide residual plots automatically. These plots often use 
standardized values (i.e., e;/ / MSE) of the residuals and predicted values, but are 
interpreted in the same way as are plots of unstandardized values. 


EXAMPLE 9.4.3 


Refer to Example 9.3.1. We wish to use residual plots to test the assumptions of linearity 
and equal variances in the data. 


Solution: A residual plot is shown in Figure 9.4.8. 

Since there is a relatively equal and random scatter of points above and 
below the residual (у; — $;) = 0 line, the linearity assumption is presumed to 
be valid. However, the funneling tendency of the plot suggests that as the 
predicted value of deep abdominal AT area increases, so does the amount of 
error. This indicates that the assumption of equal variances may not be valid 
for these data. H 


EXERCISES 


9.4.1 to 9.4.5 Refer to Exercises 9.3.3 to 9.3.7, and for each опе do the following: 
(a) Compute the coefficient of determination. 
(b) Prepare an ANOVA table and use the F statistic to test the null hypothesis that В = 0. Let 
а = .05. 
(c) Use the г statistic to test the null hypothesis that Ву = 0 at the .05 level of significance. 
(d) Determine the p value for each hypothesis test. 
(e) State your conclusions in terms of the problem. 


(f) Construct the 95 percent confidence interval for |. 
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9.5 USING THE REGRESSION EQUATION 


If the results of the evaluation of the sample regression equation indicate that there is a 
relationship between the two variables of interest, we can put the regression equation to 
practical use. There are two ways in which the equation can be used. It can be used to 
predict what value Y is likely to assume given a particular value of X. When the normality 
assumption of Section 9.2 is met, a prediction interval for this predicted value of Y may be 
constructed. 

We may also use the regression equation to estimate the mean of the sub- 
population of Y values assumed to exist at any particular value of X. Again, if the 
assumption of normally distributed populations holds, a confidence interval for this 
parameter may be constructed. The predicted value of Y and the point estimate of the 
mean of the subpopulation of Y will be numerically equivalent for any particular value 
of X but, as we will see, the prediction interval will be wider than the confidence 
interval. 


Predicting Y for a Given X If it is known, or if we are willing to assume 
that the assumptions of Section 9.2 are met, and when о is unknown, then the 100(1 — а) 
percent prediction interval for Y is given by 


2 
1 (xp — x) 
E fa /2Syq Lo + а 


(9.5.1) 


=> 
Q 


where x, is the particular value of x at which we wish to obtain a prediction interval for Y 
and the degrees of freedom used in selecting Е are n — 2. 


Estimating the Mean of У for a Given X Тһе 100(1 — о) percent 
confidence interval for Myy, when Oy is unknown, is given by 


(9.5.2) 


=> 
ц 


E f(1-0/2)Sylx 


We use MINITAB to illustrate, for a specified value of X, the calculation of a 95 percent 
confidence interval for the mean of Yand a 95 percent prediction interval for an individual Y 
measurement. 

Suppose, for our present example, we wish to make predictions and estimates about 
AT for a waist circumference of 100 cm. In the regression dialog box click on "Options." 
Enter 100 in the “Prediction interval for new observations" box. Click on “Confidence 
limits," and click on “Prediction limits.” 

We obtain the following output: 


Fit Stdev.Fit 95.0% C.I. 95.0% P.I. 
129.90 3.69 (122.58, 137.23) (63.93, 195.87) 
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Deep dominal AT area (cm?) Y 


We interpret the 95 percent confidence interval (C.I.) as follows. 

If we repeatedly drew samples from our population of men, performed a regression 
analysis, and estimated „оо with a similarly constructed confidence interval, about 
95 percent of such intervals would include the mean amount of deep abdominal AT for 
the population. For this reason we are 95 percent confident that the single interval 
constructed contains the population mean and that it is somewhere between 122.58 
and 137.23. 

Our interpretation of a prediction interval (P.I.) is similar to the interpretation of a 
confidence interval. If we repeatedly draw samples, do a regression analysis, and construct 
prediction intervals for men who have a waist circumference of 100 cm, about 95 percent of 
them will include the man's deep abdominal AT value. This is the probabilistic interpre- 
tation. The practical interpretation is that we are 95 percent confident that a man who has a 
waist circumference of 100 cm will have a deep abdominal AT area of somewhere between 
63.93 and 195.87 square centimeters. 

Simultaneous confidence intervals and prediction intervals can be calculated for all 
possible points along a fitted regression line. Plotting lines through these points will then 
provide a graphical representation of these intervals. Since the mean data point (X, Y) is 
always included in the regression equation, as illustrated by equations 9.3.2 and 9.3.3, plots 
of the simultaneous intervals will always provide the best estimates at the middle of the line 
and the error will increase toward the ends of the line. This illustrates the fact that 
estimation within the bounds of the data set, called interpolation, is acceptable, but that 
estimation outside of the bounds of the data set, called extrapolation, is not advisable since 
the pridiction error can be quite large. See Figure 9.5.1. 

Figure 9.5.2 contains a partial printout of the SAS? simple linear regression analysis 
of the data of Example 9.3.1. 


Resistant Line Frequently, data sets available for analysis by linear regression 
techniques contain one or more “unusual” observations; that is, values of x or y, ог both, 
may be either considerably larger or considerably smaller than most of the other 
measurements. In the output of Figure 9.3.2, we see that the computer detected seven 
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FIGURE 9.5.1 Simultaneous confidence intervals (a) and prediction intervals (Б) for the data in 
Example 9.3.1. 
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The SAS System 


Model: MODEL1 
Dependent Variable: Y 


Analysis of Variance 


Source 


Model 
Error 
C Total 


Sum of Mean 
DF Squares Square F Value Prob>F 


1 237548.51620 237548.51620 217.279 0.0001 
107 116981.98602 1093.28959 
108 354530.50222 


Root MSE 33.06493 R-square 
Dep Mean 101.89404 Adj R-sq 


сем 


32.45031 


Parameter Estimates 


Parameter Standard T for HO: 


Variable DF Estimate Error Parameter =0 Prob > |T| 


INTERCEP 
X 


1 -215.981488 21.79627076 -9.909 0.0001 
1. 3.458859 0.23465205 14.740 0.0001 


FIGURE 9.5.2 Partial printout of the computer analysis of the data given in Example 9.3.1, 
using the SAS? software package. 


unusual observations in the waist circumference and deep abdominal AT data shown in 
Table 9.3.1. 

The least-squares method of fitting a straight line to data is sensitive to unusual 
Observations, and the location of the fitted line can be affected substantially by them. 
Because of this characteristic of the least-squares method, the resulting least-squares line is 
said to lack resistance to the influence of unusual observations. Several methods have been 
devised for dealing with this problem, including one developed by John W. Tukey. The 
resulting line is variously referred to as Tukey's line and the resistant line. 

Based on medians, which, as we have seen, are descriptive measures that are 
themselves resistant to extreme values, the resistant line methodology is an exploratory 
data analysis tool that enables the researcher to quickly fit a straight line to a set of data 
consisting of paired x, y measurements. The technique involves partitioning, on the basis of 
the independent variable, the sample measurements into three groups of as near equal size 
as possible: the smallest measurements, the largest measurements, and those in between. 
The resistant line is the line fitted in such a way that there are an equal number of values 
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Dialog box: Session command: 


Stat » EDA » Resistant Line МТВ > Name C3 —'RESI1' СА = "КІТЗ1" 


МТВ > RLine C2 Cl '’ВЕЗТ1’ 'FITSI1'; 
SUBC» MaxIterations 10. 


Type C2 in Response and C/ in Predictors. 


Check Residuals and Fits. Click OK. 


Output: 


Resistant Line Fit: C2 versus C1 


Slope - 


3.2869 Level = -203.7868 Half-slope ratio= 0.690 


FIGURE 9.5.3 MINITAB resistant line procedure and output for the data of Table 9.3.1. 


above and below it in both the smaller group and the larger group. The resulting slope and 
y-intercept estimates are resistant to the effects of either extreme y values, extreme x values, 
or both. To illustrate the fitting of a resistant line, we use the data of Table 9.3.1 and 
MINITAB. The procedure and output are shown in Figure 9.5.3. 

We see from the output in Figure 9.5.3 that the resistant line has a slope of 3.2869 and 
a y-intercept of —203.7868. The half-slope ratio, shown in the output as equal to .690, is an 
indicator of the degree of linearity between x and y. A slope, called a half-slope, is 
computed for each half of the sample data. The ratio of the right half-slope, Pg, and the left 
half-slope, фі, is equal to bg /bi.. If the relationship between x and y is straight, the half- 
slopes will be equal, and their ratio will be 1. A half-slope ratio that is not close to 1 
indicates a lack of linearity between x and y. 

The resistant line methodology is discussed in more detail by Hartwig and Dearing 
(1), Johnstone and Velleman (2), McNeil (3), and Velleman and Hoaglin (4). 


EXERCISES 


9.5.1 
9.5.2 
9.5.3 
9.5.4 
9.5.5 


In each exercise refer to the appropriate previous exercise and, for the value of X indicated, 
(a) construct the 95 percent confidence interval for Шух and (b) construct the 95 percent 
prediction interval for Y. 

Refer to Exercise 9.3.3 and let X — 400. 

Refer to Exercise 9.3.4 and let X — 1.6. 

Refer to Exercise 9.3.5 and let X — 4.16. 

Refer to Exercise 9.3.6 and let X — 29.4. 

Refer to Exercise 9.3.7 and let X — 35. 
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9.6 THE CORRELATION MODEL 


In the classic regression model, which has been the underlying model in our discussion up 
to this point, only Y, which has been called the dependent variable, is required to be random. 
The variable X is defined as a fixed (nonrandom or mathematical) variable and is referred to 
as the independent variable. Recall, also, that under this model observations are frequently 
obtained by preselecting values of X and determining corresponding values of Y 

When both Y and X are random variables, we have what is called the correlation 
model. Typically, under the correlation model, sample observations are obtained by 
selecting a random sample of the units of association (which may be persons, places, 
animals, points in time, or any other element on which the two measurements are taken) 
and taking on each a measurement of X and a measurement of Y. In this procedure, values of 
X are not preselected but occur at random, depending on the unit of association selected in 
the sample. 

Although correlation analysis cannot be carried out meaningfully under the classic 
regression model, regression analysis can be carried out under the correlation model. 
Correlation involving two variables implies a co-relationship between variables that puts 
them on an equal footing and does not distinguish between them by referring to one as the 
dependent and the other as the independent variable. In fact, in the basic computational 
procedures, which are the same as for the regression model, we may fit a straight line to the 
data either by minimizing У (y; — $.) or by minimizing У) (x; — £;)?. In other words, we 
may do a regression of X on Y as well as a regression of Y on X. The fitted line in the two 
cases in general will be different, and a logical question arises as to which line to fit. 

If the objective is solely to obtain a measure of the strength of the relationship 
between the two variables, it does not matter which line is fitted, since the measure usually 
computed will be the same in either case. If, however, it is desired to use the equation 
describing the relationship between the two variables for the purposes discussed in the 
preceding sections, it does matter which line is fitted. The variable for which we wish to 
estimate means or to make predictions should be treated as the dependent variable; that is, 
this variable should be regressed on the other variable. 


The Bivariate Normal Distribution Under the correlation model, X and Y 
are assumed to vary together in what is called a joint distribution. If this joint distribution is 
a normal distribution, it is referred to as a bivariate normal distribution. Inferences 
regarding this population may be made based on the results of samples properly drawn 
from it. If, on the other hand, the form of the joint distribution is known to be nonnormal, or 
if the form is unknown and there is no justification for assuming normality, inferential 
procedures are invalid, although descriptive measures may be computed. 


Correlation Assumptions The following assumptions must hold for infer- 
ences about the population to be valid when sampling is from a bivariate distribution. 
1. For each value of X there is a normally distributed subpopulation of Y values. 
2. For each value of Y there is a normally distributed subpopulation of X values. 


3. The joint distribution of X and Y is a normal distribution called the bivariate normal 
distribution. 
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ХХ, Y) KX, Y) 
Y X p 
(a) (b) 
AX Y) 
Y X 


(c) 
FIGURE 9.6.1 A bivariate normal distribution. (а) A bivariate normal distribution. (b) А 
cutaway showing normally distributed subpopulation of Y for given X. (c) A cutaway showing 
normally distributed subpopulation of X for given Y. 


4. The subpopulations of Y values all have the same variance. 


5. The subpopulations of X values all have the same variance. 


The bivariate normal distribution is represented graphically in Figure 9.6.1. In this 
illustration we see that if we slice the mound parallel to Yat some value of X, the cutaway 
reveals the corresponding normal distribution of Y. Similarly, a slice through the mound 
parallel to X at some value of Y reveals the corresponding normally distributed sub- 
population of X. 


9.7 THE CORRELATION COEFFICIENT 


The bivariate normal distribution discussed in Section 9.6 has five parameters, ох, Oy, Ly, 
Му» and p. The first four are, respectively, the standard deviations and means associated 
with the individual distributions. The other parameter, o, is called the population 
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X 
FIGURE 9.7.1 Scatter diagram for г = — 1. 


correlation coefficient and measures the strength of the linear relationship between X 
and Y. 

The population correlation coefficient is the positive or negative square root of p?, 
the population coefficient of determination previously discussed, and since the coefficient 
of determination takes on values between 0 and 1 inclusive, р may assume any value 
between —1 and +1. If p — 1 there is a perfect direct linear correlation between the two 
variables, while o — —1 indicates perfect inverse linear correlation. If o — 0 the two 
variables are not linearly correlated. The sign of p will always be the same as the sign of fj, 
the slope of the population regression line for X and Y. 

The sample correlation coefficient, r, describes the linear relationship between the 
sample observations on two variables in the same way that p describes the relationship in a 
population. The sample correlation coefficient is the square root of the sample coefficient 
of determination that was defined earlier. 

Figures 9.4.5(d) and 9.4.5(c), respectively, show typical scatter diagrams where 
г 0(7? = 0) and r = +1(r? = 1). Figure 9.7.1 shows a typical scatter diagram where 
r=-l. 

We are usually interested in knowing if we may conclude that o Z 0, that is, that X 
and Yare linearly correlated. Since p is usually unknown, we draw a random sample from 
the population of interest, compute г, the estimate of o, and test Но: o = 0 against the 
alternative р 4 0. The procedure will be illustrated in the following example. 


EXAMPLE 9.7.1 


The purpose of a study by Kwast-Rabben et al. (A-7) was to analyze somatosensory evoked 
potentials (SEPs) and their interrelations following stimulation of digits I, III, and V in the 
hand. The researchers wanted to establish reference criteria in a control population. Thus, 
healthy volunteers were recruited for the study. In the future this information could be quite 
valuable as SEPs may provide a method to demonstrate functional disturbances in patients 
with suspected cervical root lesion who have pain and sensory symptoms. In the study, 
stimulation below-pain-level intensity was applied to the fingers. Recordings of spinal 
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responses were made with electrodes fixed by adhesive electrode cream to the subject's 
skin. One of the relationships of interest was the correlation between a subject's height 
(cm) and the peak spinal latency (Cv) of the SEP. The data for 155 measurements are shown 
in Table 9.7.1. 


TABLE 9.7.1 Height and Spine SEP Measurements (Cv) 
from Stimulation of Digit | for 155 Subjects Described 
in Example 9.7.1 


Height Cv Height Cv Height Cv 
149 14.4 168 16.3 181 15.8 
149 13.4 168 15.3 181 18.8 
155 13.5 168 16.0 181 18.6 
155 13.5 168 16.6 182 18.0 
156 13.0 168 15.7 182 17.9 
156 13.6 168 16.3 182 17.5 
157 14.3 168 16.6 182 17.4 
157 14.9 168 15.4 182 17.0 
158 14.0 170 16.6 182 17.5 
158 14.0 170 16.0 182 17.8 
160 15.4 170 17.0 184 18.4 
160 14.7 170 16.4 184 18.5 
161 15.5 171 16.5 184 17.7 
161 15.7 171 16.3 184 17.7 
161 15.8 171 16.4 184 17.4 
161 16.0 171 16.5 184 18.4 
161 14.6 172 17.6 185 19.0 
161 15.2 172 16.8 185 19.6 
162 15.2 172 17.0 187 19.1 
162 16.5 172 17.6 187 19.2 
162 17.0 173 17.3 187 17.8 
162 14.7 173 16.8 187 19.3 
163 16.0 174 15.5 188 17.5 
163 15.8 174 15.5 188 18.0 
163 17.0 175 17.0 189 18.0 
163 15.1 175 15.6 189 18.8 
163 14.6 175 16.8 190 18.3 
163 15.6 175 17.4 190 18.6 
163 14.6 175 17.6 190 18.8 
164 17.0 175 16.5 190 19.2 
164 16.3 175 16.6 191 18.5 
164 16.0 175 17.0 191 18.5 
164 16.0 176 18.0 191 19.0 
165 15.7 176 17.0 191 18.5 
165 16.3 176 17.4 194 19.8 


(Continued ) 
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Height Cv Height Cv Height Cv 
165 17.4 176 18.2 194 18.8 
165 17.0 176 17.3 194 18.4 
165 16.3 177 17.2 194 19.0 
166 14.1 177 18.3 195 18.0 
166 14.2 179 16.4 195 18.2 
166 14.7 179 16.1 196 17.6 
166 13.9 179 17.6 196 18.3 
166 17.2 179 17.8 197 18.9 
167 16.7 179 16.1 197 19.2 
167 16.5 179 16.0 200 21.0 
167 14.7 179 16.0 200 19.2 
167 14.3 179 17.5 202 18.6 
167 14.8 179 17.5 202 18.6 
167 15.0 180 18.0 182 20.0 
167 15.5 180 17.9 190 20.0 
167 15.4 181 18.4 190 19.5 
168 17.3 181 16.4 


Source: Data provided courtesy of Olga Kwast-Rabben, Ph.D. 


Solution: 


21[- 


Cv (units) 


13[- 
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The scatter diagram and least-squares regression line are shown in Figure 9.7.2. 
Let us assume that the investigator wishes to obtain a regression 
equation to use for estimating and predicting purposes. In that case the 
sample correlation coefficient will be obtained by the methods discussed 
under the regression model. 


FIGURE 9.7.2 Height and cervical (spine) potentials in digit | 
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stimulation for the data described in Example 9.7.1. 
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The regression equation is 
-3.20 + 0.115 Height 


Predictor 
Constant 
Height 


Coef SE Coef T P 
-3.198 1.016 =З 15 0.002 
0.114567 0.005792 19.78 0.000 


$ = 0.8573 R-Sq = 71.9% R-Sq (adj) 


Analysis of Variance 


Source DF SS 
Regression 1 

Residual Error 153 .44 
Total 154 .00 


Unusual Observations 

Obs Height Cv Fit SE Fit Residual St Resid 
39 166 14.1000 15.9199 .0865 ¿TAO .02R 
42 166 13.9000 15.8199 .0865 .9199 .25R 
105 181 15.8000 17.5384 207770 . 7384 .04R 
151 202 18.6000 19.9443 .1706 .3443 .60 X 
152 202 18.6000 19.9443 .1706 .3443 .60 X 
153 182 20.0000 17.6529 .0798 .3471 «1 DR 


R denotes an observation with a large standardized residual 
X denotes an observation whose X value gives it large influence. 


FIGURE 9.7.3 MINITAB output for Example 9.7.1 using the simple regression procedure. 


The Regression Equation 


Let us assume that we wish to predict Cv levels from knowledge of heights. In that case we 
treat height as the independent variable and Cv level as the dependent variable and obtain 
the regression equation and correlation coefficient with MINITAB as shown in Figure 9.7.3. 
For this example г = y.719 = .848. We know that г is positive because the slope of the 
regression line is positive. We may also use the MINITAB correlation procedure to obtain r 
as shown in Figure 9.7.4. 

The printout from the SAS® correlation procedure is shown in Figure 9.7.5. Note that 
the SAS® procedure gives descriptive measures for each variable as well as the p value for 
the correlation coefficient. 

When a computer is not available for performing the calculations, r may be obtained 
by means of the following formulas: 


ERE т 
ON EXE й 


Data: 


Elis 
C2: 


Height 
Cv 


Dialog Box: 


Stat » Basic Statistics » Correlation 


Type СІ C2 in Variables. Click OK. 


OUTPUT: 
Correlations: Height, Cv 


Pearson correlation of Height and 
P-Value - 0.000 
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Session command: 


MTB > Correlation C1 


Cv = 0.848 


FIGURE 9.7.4 MINITAB procedure for Example 9.7.1 using the correlation command. 


The CORR Procedure 


2 Variables: 


HEIGHT CV 


Simple Statistics 


Mean 
175.04516 
16.85613 


Variable N 
HEIGHT 155 
CV 155 


Pearson Correlation Coefficients, 


Prob > |r| 


HEIGHT 
1.00000 


0.84788 


Std Dev 
11.92745 
1.61165 


under HO: 


Maximum 
202.00000 
21.00000 


Minimum 
149.00000 
13.00000 


Sum 
27132 
2613 


М = 155 
Rho=0 


CV 
0.84788 
<.0001 
1.00000 


<.0001 


FIGURE 9.7.5 SAS? printout for Example 9.7.1. 
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An alternative formula for computing r is given by 


cs n iy; 07)0 yu) 
үп - мт (y 


(9.7.2) 


An advantage of this formula is that r may be computed without first computing b. 
This is the desirable procedure when it is not anticipated that the regression equation will 


be used. 


Remember that the sample correlation coefficient, r, will always have the same sign 
as the sample slope, b. ш 


EXAMPLE 9.7.2 


Refer to Example 9.7.1. We wish to see if the sample value of r — .848 is of sufficient 
magnitude to indicate that, in the population, height and Cv SEP levels are correlated. 


Solution: We conduct a hypothesis test as follows. 


1. 
2. 


Data. See the initial discussion of Example 9.7.1. 


Assumptions. We presume that the assumptions given in Section 9.6 
are applicable. 


. Hypotheses. 


Ho: р =0 
Ha: p #0 


. Test statistic. When р = 0, it can be shown that the appropriate test 


statistic 15 


n—2 


t—r 
1 — r? 


(9.7.3) 


Distribution of test statistic. When Но 15 true and the assumptions are 
met, the test statistic 1s distributed as Student's г distribution with n — 2 
degrees of freedom. 


Decision rule. If we let о = .05, the critical values of t in the present 
example are 31.9754 (by interpolation). If, from our data, we compute a 
value of t that is either greater than or equal to 4-1.9754 or less than or 
equal to —1.9754, we will reject the null hypothesis. 


Calculation of test statistic. Our calculated value of / is 


153 
t = .84 = 19.787 
i 1 — .719 с 


Statistical decision. Since the computed value of the test statistic does 
exceed the critical value of t, we reject the null hypothesis. 
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9. Conclusion. We conclude that, in the population, height and SEP levels 
in the spine are linearly correlated. 


10. p value. Since г = 19.787 > 2.6085 (interpolated value of t for 153, 
.995), we have for this test, p « .005. я 


One may also notice that the test statistic for the correlation coefficient is equivalent 
to the test statistic for the slope of the regression line. Hence, squaring the f statistic in 
solution step 7 results in the F statistic provided in Figure 9.7.3. This may be useful when 
using a computer package that does not routinely provide the t statistic for the correlation 
coefficient (e.g., SPSS) and one does not wish to calculate the test statistic by hand. 


A Test for Use When the Hypothesized p Is a Nonzero Value The 
use of the t statistic computed in the above test is appropriate only for testing Ho : o — 0. If 
it is desired to test Ho : р = ру, where ру is some value other than zero, we must use 
another approach. Fisher (5) suggests that r be transformed to z, as follows: 


Zr = = In —— (9.7.4) 


where ln is a natural logarithm. It can be shown that z, is approximately normally distributed 
with a mean of z, = 5 In {(1 + p)/(1 — p)) and estimated standard deviation of 


o, = 


1 
== (9.7.5) 
уп—3 
To test the null hypothesis that о is equal to some value other than zero, the test 


statistic is 
Zr A Zp 


1/Vn-3 


which follows approximately the standard normal distribution. 

To determine z, for an observed г and z, for a hypothesized р, we consult Table I, 
thereby avoiding the direct use of natural logarithms. 

Suppose in our present example we wish to test 


Z= (9.7.6) 


Ho: P= .80 
against the alternative 
Ha Dp A .80 
at the .05 level of significance. By consulting Table I (and interpolating), we find that for 
r —.848, 2, = 1.24726 
and for 
p=.80, z, = 1.09861 
Our test statistic, then, is 


_ 1.24726 — 1.09861 _ 


1.83 
1/V/155 —3 
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Since 1.83 is less than the critical value of z = 1.96, we are unable to reject Но. We 
conclude that the population correlation coefficient may be .80. 

For sample sizes less than 25, Fisher's Z transformation should be used with caution, 
if at all. An alternative procedure from Hotelling (6) may be used for sample sizes equal to 
or greater than 10. In this procedure the following transformation of r is employed: 


За, + 
E (9.7.7) 
4n 
The standard deviation of z* is 
1 
On = (9.7.8) 
n— 1 


The test statistic is 


a E жыр (9.7.9) 


where 
(3z, + p) 


Е а zeta) = Zp — 
і" (pronounced zeta) = zp 35 


Critical values for comparison purposes are obtained from the standard normal 
distribution. 

In our present example, to test Но: o = .80 against Ha : p # .80 using the Hotel- 
ling transformation and o — .05, we have 


3(1.24726) + .848 

* = 1.2472 = 1.2 

5 6 4(155) 339 
3(1.09861) + .8 

А 0986 4(155) 0920 


Z* = (1.2339 — 1.0920) /155 - 1 = 1.7609 


Since 1.7600 is less than 1.96, the null hypothesis is not rejected, and the same conclusion 
is reached as when the Fisher transformation is used. 


Alternatives In some situations the data available for analysis do not meet the 
assumptions necessary for the valid use of the procedures discussed here for testing 
hypotheses about a population correlation coefficient. In such cases it may be more 
appropriate to use the Spearman rank correlation technique discussed in Chapter 13. 


Confidence Interval for о Fisher's transformation may be used to construct 
100(1 — o) percent confidence intervals for o. The general formula for a confidence 
interval 


estimator + (reliability factor) (standard error) 
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is employed. We first convert our estimator, r, to z,, construct a confidence interval about z,, 
and then reconvert the limits to obtain a 100(1 — a) percent confidence interval about p. 
The general formula then becomes 


2, +2(1/va—3) (9.7.10) 


For our present example the 95 percent confidence interval for z, is given by 


1.24726 + 1.96(1/V/155 — 3) 
(1.08828, 1.40624) 


Converting these limits (by interpolation in Appendix Table I), which are values of z,, 
into values of r gives 


Zr r 


1.08828 11962 
1.40624 .8866 


We are 95 percent confident, then, that р 15 contained in the interval .7962 to .88866. Because 
of the limited entries in the table, these limits must be considered as only approximate. 


EXERCISES 


In each of the following exercises: 


(a) Prepare a scatter diagram. 
(b) Compute the sample correlation coefficient. 
(c) Test Но: p = 0 at the .05 level of significance and state your conclusions. 
(d) Determine the p value for the test. 
(e) Construct the 95 percent confidence interval for р. 
9.7.1 The purpose of a study by Brown and Persley (A-8) was to characterize acute hepatitis A in patients 
more than 40 years old. They performed a retrospective chart review of 20 subjects who were 


diagnosed with acute hepatitis A, but were not hospitalized. Of interest was the use of age (years) to 
predict bilirubin levels (mg/dl). The following data were collected. 


Age (Years) Bilirubin (mg/dl) Age (Years) Bilirubin (mg/dl) 
78 7:5 44 7.0 
72 12.9 42 1.8 
81 14.3 45 8 
59 8.0 78 3.8 
64 14.1 47 3.5 
48 10.9 50 5.1 
46 12.3 57 16.5 
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9.7.2 


Age (Years) Bilirubin (mg/dl) Age (Years) Bilirubin (mg/dl) 


Source: Data provided courtesy of Geri R. Brown, M.D. 


Another variable of interest in the study by Reiss et al. (A-3) (see Exercise 9.3.4) was partial 
thromboplastin (aPTT), the standard test used to monitor heparin anticoagulation. Use the data in the 
following table to examine the correlation between aPTT levels as measured by the CoaguCheck 
point-of-care assay and standard laboratory hospital assay in 90 subjects receiving heparin alone, 
heparin with warfarin, and warfarin and exoenoxaparin. 


Warfarin and 


Heparin Warfarin Exoenoxaparin 
CoaguCheck Hospital CoaguCheck Hospital CoaguCheck Hospital 
aPTT aPTT aPTT aPTT aPTT aPTT 

49.3 71.4 18.0 77.0 56.5 46.5 
57.9 86.4 312 62.2 50.7 34.9 
59.0 75.6 58.7 53.2 37.3 28.0 
77.3 54.5 75.2 53.0 64.8 52.3 
42.3 57Л 18.0 45Л 41.2 37.5 
44.3 59.5 82.6 81.1 90.1 47.1 
90.0 77.2 29.6 40.9 23.1 27.1 
55.4 63.3 82.9 75.4 53.2 40.6 
20.3 27.6 58.7 55.7 27.3 37.8 
28.7 52.6 64.8 54.0 67.5 50.4 
64.3 101.6 37.9 79.4 33.6 342 
90.4 89.4 812 62.5 45.1 34.8 
64.3 66.2 18.0 36.5 56.2 44.2 
89.8 69.8 38.8 32.8 26.0 28.2 
74.7 91.3 95.4 68.9 67.8 46.3 
150.0 118.8 53.7 71.3 40.7 41.0 
32.4 30.9 128.3 111.1 36.2 35.7 
20.9 65.2 60.5 80.5 60.8 47.2 
89.5 77.9 150.0 150.0 30.2 39.7 
44.7 91.5 38.5 46.5 18.0 31.3 
61.0 90.5 58.9 89.1 55.6 53.0 
36.4 33.6 112.8 66.7 18.0 27.4 
52.9 88.0 26.7 29.5 18.0 35.7 
57.5 69.9 49.7 47.8 78.3 62.0 
39.1 41.0 85.6 63.3 75.3 36.7 
74.8 81.7 68.8 43.5 73.2 85.3 
32.5 33.3 18.0 54.0 42.0 38.3 
125.7 142.9 92.6 100.5 49.3 39.8 
77.1 98.2 46.2 52.4 22.8 42.3 
143.8 108.3 60.5 93.7 35.8 36.0 


Source: Data provided courtesy of Curtis E. Haas, Pharm.D. 


9.7.3 


9.7.4 
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In the study by Parker et al. (A-4) (see Exercise 9.3.5), the authors also looked at the change in AUC 
(area under the curve of plasma concentration of digoxin) when comparing digoxin levels taken with 
and without grapefruit juice. The following table gives the AUC when digoxin was consumed with 
water (ng-hr/ml) and the change in AUC compared to the change in AUC when digoxin is taken with 
grapefruit juice (СРЈ, 96). 


Water AUC Level Change in AUC 
(ng - hr/ml) with СЕЈ (96) 

6.96 17.4 

5.59 24.5 

5.31 8.5 

8.22 20.8 
11.91 —26.7 

9.50 —29.3 
11.28 —16.8 


Source: Data provided courtesy of Robert B. Parker, 
Pharm.D. 


An article by Tuzson et al. (A-9) in Archives of Physical Medicine and Rehabilitation reported the 
following data on peak knee velocity in walking (measured in degrees per second) at flexion and 
extension for 18 subjects with cerebral palsy. 


Flexion (°/s) Extension (°/s) 
100 100 
150 150 
210 180 
255 165 
200 210 
185 155 
440 440 
110 180 
400 400 
160 140 
150 250 
425 275 
375 340 
400 400 
400 450 
300 300 
300 300 
320 275 


Source: Ann E. Tuzson, Kevin P. Granata, 

and Mark Е Abel, “Spastic Velocity Threshold 
Constrains Functional Performance in 

Cerebral Palsy," Archives of Physical Medicine 
and Rehabilitation, 84 (2003), 1363-1368. 
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9.7.5 Amyotrophic lateral sclerosis (ALS) is characterized by a progressive decline of motor function. The 
degenerative process affects the respiratory system. Butz et al. (A-10) investigated the longitudinal 
impact of nocturnal noninvasive positive-pressure ventilation on patients with ALS. Prior to 
treatment, they measured partial pressure of arterial oxygen (Рао) and partial pressure of arterial 
carbon dioxide (Paco?) in patients with the disease. The results were as follows: 


Paco; Pao; 

40.0 101.0 

47.0 69.0 

34.0 132.0 

42.0 65.0 

54.0 72.0 

48.0 76.0 

53.6 67.2 

56.9 70.9 

58.0 73.0 

45.0 66.0 

54.5 80.0 

54.0 72.0 

43.0 105.0 

44.3 113.0 

53.9 69.2 

41.8 66.7 

33.0 67.0 

43.1 77.5 

524 65.1 

37.9 71.0 

34.5 86.5 

40.1 74.7 

33.0 94.0 

59.9 60.4 

62.6 52.5 

54.1 76.9 Source: M. Butz, К. H. Wollinsky, U. Widemuth-Catrinescu, 
45.7 65.3 А. Sperfeld, S. Winter, H. Н. Mehrkens, А. C. Ludolph, and 
40.6 80.3 H. Schreiber, "Longitudinal Effects of Noninvasive Positive- 
56.6 53.2 Pressure Ventilation in Patients with Amyotrophic Lateral 
50.0 71.9 Sclerosis,” American Journal of Medical Rehabilitation, 82 


(2003) 597-604. 


9.7.6 А simple random sample of 15 apparently healthy children between the ages of 6 months and 15 years 
yielded the following data on age, X, and liver volume per unit of body weight (ml/kg), Y: 


X Y X Y 
9 41 10.0 26 
a 55 10.1 35 

2.5 41 10.9 25 

41 39 11.5 31 


(Continued ) 
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X Y X Y 
5.9 50 12.1 31 
6.1 32 14.1 29 
7.0 41 15.0 23 
8.2 42 


9.8 SOME PRECAUTIONS 


Regression and correlation analysis are powerful statistical tools when properly employed. 
Their inappropriate use, however, can lead only to meaningless results. To aid in the proper 
use of these techniques, we make the following suggestions: 


1. The assumptions underlying regression and correlation analysis should be reviewed 
carefully before the data are collected. Although it is rare to find that assumptions are 
met to perfection, practitioners should have some idea about the magnitude of the gap 
that exists between the data to be analyzed and the assumptions of the proposed 
model, so that they may decide whether they should choose another model; proceed 
with the analysis, but use caution in the interpretation of the results; or use the chosen 
model with confidence. 


2. In simple linear regression and correlation analysis, the two variables of interest are 
measured on the same entity, called the unit of association. If we are interested in the 
relationship between height and weight, for example, these two measurements are 
taken on the same individual. It usually does not make sense to speak of the 
correlation, say, between the heights of one group of individuals and the weights of 
another group. 


3. No matter how strong is the indication of a relationship between two variables, it 
should not be interpreted as one of cause and effect. If, for example, a significant 
sample correlation coefficient between two variables X and Y is observed, it can mean 
one of several things: 

(a) X causes Y. 

(b) Y causes X. 

(c) Some third factor, either directly or indirectly, causes both X and Y. 

(d) An unlikely event has occurred and a large sample correlation coefficient has 
been generated by chance from a population in which X and Y are, in fact, not 
correlated. 

(e) The correlation is purely nonsensical, a situation that may arise when measure- 
ments of X and Y are not taken on a common unit of association. 


4. The sample regression equation should not be used to predict or estimate outside the 
range of values of the independent variable represented in the sample. As illustrated 
in Section 9.5, this practice, called extrapolation, is risky. The true relationship 
between two variables, although linear over an interval of the independent variable, 
sometimes may be described at best as a curve outside this interval. If our sample by 
chance is drawn only from the interval where the relationship is linear, we have only a 
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Extrapolation 


Extrapolation 


M 


Vv 
Sampled Interval 


FIGURE 9.8.1 Example of extrapolation. 


limited representation of the population, and to project the sample results beyond the 
interval represented by the sample may lead to false conclusions. Figure 9.8.1 
illustrates the possible pitfalls of extrapolation. 


9.9 SUMMARY 


In this chapter, two important tools of statistical analysis, simple linear regression and 
correlation, are examined. The following outline for the application of these techniques has 
been suggested. 


1. 


Identify the model. Practitioners must know whether the regression model or the 
correlation model is the appropriate one for answering their questions. 


Review assumptions. It has been pointed out several times that the validity of the 
conclusions depends on how well the analyzed data fit the chosen model. 


Obtain the regression equation. We have seen how the regression equation is 
obtained by the method of least squares. Although the computations, when done by 
hand, are rather lengthy, involved, and subject to error, this is not the problem today 
that it has been in the past. Computers are now in such widespread use that the 
researcher or statistician without access to one is the exception rather than the rule. 
No apology for lengthy computations is necessary to the researcher who has a 
computer available. 


Evaluate the equation. We have seen that the usefulness of the regression equation 
for estimating and predicting purposes is determined by means of the analysis of 
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variance, which tests the significance of the regression mean square. The strength of 
the relationship between two variables under the correlation model is assessed by 
testing the null hypothesis that there is no correlation in the population. If this 
hypothesis can be rejected we may conclude, at the chosen level of significance, that 


the two variables are correlated. 


5. Use the equation. Once it has been determined that it is likely that the regression 
equation provides a good description of the relationship between two variables, X and 
Y, it may be used for one of two purposes: 


(a) To predict what value Y is likely to assume, given a particular value of X, or 
(b) To estimate the mean of the subpopulation of Y values for a particular value 


This necessarily abridged treatment of simple linear regression and correlation may 
have raised more questions than it has answered. It may have occurred to the reader, for 
example, that a dependent variable can be more precisely predicted using two or more 
independent variables rather than one. Or, perhaps, he or she may feel that knowledge of 
the strength of the relationship among several variables might be of more interest than 
knowledge of the relationship between only two variables. The exploration of these 
possibilities is the subject of the next chapter, and the reader's curiosity along these lines 
should be at least partially relieved. 

For those who would like to pursue further the topic of regression analysis a number 
of excellent references are available, including those by Dielman (7), Hocking (8), 
Mendenhall and Sincich (9), and Neter et al. (10). 


SUMMARY OF FORMULAS FOR CHAPTER 9 


Formula 

Number Name Formula 

9.2.1 Assumption of Шух = Bo + Bix 
linearity 

9.2.2 Simple linear у= В + fix Е 
regression model 

9.2.3 Error (residual) term € = y — (fo + Bix) = Y — шух 

9.3.1 Algebraic y=a+bx 
representation 
of a straight line 

9.3.2 Least square " І M 
estimate of the À 2 НОЯ 
slope of a Bi = n " 

(x; — X) 


regression line 


(Continued ) 
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9.3.3 Least square estimate Bo зу- Bi X 
of the intercept of a 
regression line 
9.4.1 Deviation equation (y; - У) = (=) + vi - У) 
942 Sum-of-squares X0-3'-X6:-3'«-X060,-5* 
equation 
9.4.3 Estimated Р У yy Yrs) 
population F 1 
coefficient of 20-9 0-0 
determination 
9.4.4-9.4.7 Means and ий = Bo 
variances of > д 
point estimators SAT ees бу 2% 
d b Bo n 
pum n "(хі — xy 
i=l 
ИВ, = Bi 
2 ШЇ 
% a 5 
Da- 
i=l 
9.4.8 z statistic for testing В! — (Ві)о 
hypotheses em I 
about f fo 
9.4.9 t statistic for testing Êi - (81) 
hypotheses iom S; 
about В Po 
9.5.1 Prediction | ( >) 
: Xp — X 
interval for Y $ + ta—aj2)Sy/x4| 1+- + Р > 3 
for a given X п X x-—Xx) 
9.5.2 Confidence 1 ( а) 
interval for Ў taa) Syk] - + ёз ш, 
the mean of Y n j(u-X 
for a given X 
9.7.1-9.7.2 Correlation coefficient 22 
А [xx — Qum] 
"cu 
2 
= 
n» чу 00 у) 
VER La y 
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9.7.3 t statistic for n—2 
correlation coefficient t=r 1-542 

9.7.4 z statistic for m hs l+r 
correlation coefficient зла 2 l-r 

9.7.5 Estimated standard mie 1 
deviation for z statistic SV EA 

9.7.6 Z statistic for — _© — 4 
correlation coefficient 1/Уп- 3 

9.7.7 Z statistic for s, З tr 
correlation coefficient еа: 4п 
when n « 25 

9.7.8 Standard deviation for una. 1 
z“ й n—3 

T: Z' statistic Ё ' *— 

249 антени eas | E Eo Te 

correlation coefficient 1/vn—1 
ж (32, + p ) 
iuum 4n 

9.7.10 Confidence interval Z,= Z(1/ по 3) 

Того 
Symbol Key • Ву = regression intercept term 


e Во = estimated regression intercept 

* a = probability of type I error or regression intercept 
• Ву = estimated regression slope 

• D, = regression slope 

* € — error term 

e u, = population mean of statistic / variable x 

* n — sample size 


* о? = population variance of statistic/variable x 


x 
* p= population correlation coefficient 
* r — sample correlation coefficient 
* у? = sample coefficient of determination 
e роз (statistic 
* x; — value of independent variable at 
* x — sample mean of independent variable 
* y, — value of dependent variable at 
* y — sample mean of dependent variable 
• y = estimated y 
* z — z statistic 
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REVIEW QUESTIONS AND EXERCISES 


Ps Oe БӘ 


ER Ж; 


10. 
11. 
12. 
13. 


14. 


15. 


16. 


What are the assumptions underlying simple linear regression analysis when one of the objectives is 
to make inferences about the population from which the sample data were drawn? 


Why is the regression equation called the least-squares equation? 
Explain the meaning of Bo in the sample regression equation. 
Explain the meaning of В, in the sample regression equation. 


Explain the following terms: 
(a) Total sum of squares 
(b) Explained sum of squares 


(c) Unexplained sum of squares 

Explain the meaning of and the method of computing the coefficient of determination. 

What is the function of the analysis of variance in regression analysis? 

Describe three ways in which one may test the null hypothesis that Bi =0. 

For what two purposes can a regression equation be used? 

What are the assumptions underlying simple correlation analysis when inference is an objective? 
What is meant by the unit of association in regression and correlation analysis? 

What are the possible explanations for a significant sample correlation coefficient? 


Explain why it is risky to use a sample regression equation to predict or to estimate outside the range 
of values of the independent variable represented in the sample. 


Describe a situation in your particular area of interest where simple regression analysis would be 
useful. Use real or realistic data and do a complete regression analysis. 


Describe a situation in your particular area of interest where simple correlation analysis would be 
useful. Use real or realistic data and do a complete correlation analysis. 


In each of the following exercises, carry out the required analysis and test hypotheses at the indicated 
significance levels. Compute the p value for each test. 


A study by Scrogin et al. (A-11) was designed to assess the effects of concurrent manipulations of 
dietary NaCl and calcium on blood pressure as well as blood pressure and catecholamine responses to 
stress. Subjects were salt-sensitive, spontaneously hypertensive male rats. Among the analyses 
performed by the investigators was a correlation between baseline blood pressure and plasma 
epinephrine concentration (E). The following data on these two variables were collected. 
Let a = .01. 


BP PlasmaE BP PlasmaE 
163.90 248.00 143.20 179.00 
195.15 339.20 166.00 160.40 
170.20 193.20 160.40 263.50 
171.10 307.20 170.90 184.70 


(Continued ) 


17. 


REVIEW QUESTIONS AND EXERCISES 


BP PlasmaE BP PlasmaE 
148.60 80.80 150.90 227.50 
195.70 550.00 159.60 92.35 
151.00 70.00 141.60 139.35 
166.20 66.00 160.10 173.80 
177.80 120.00 166.40 224.80 
165.10 281.60 162.00 183.60 
174.70 296.70 214.20 441.60 
164.30 217.30 179.70 612.80 
152.50 88.00 178.10 401.60 
202.30 268.00 198.30 132.00 
171.70 265.50 


Source: Data provided courtesy of Karie E. Scrogin. 
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Dean Parmalee (A-12) wished to know if the year-end grades assigned to Wright State University 
Medical School students are predictive of their second-year board scores. The following table shows, 
for 89 students, the year-end score (AVG, in percent of 100) and the score on the second-year medical 
board examination (BOARD). 


AVG BOARD AVG BOARD AVG BOARD 
95.73 257 85.91 208 82.01 196 
94.03 256 85.81 210 81.86 179 
91.51 242 85.35 212 81.70 207 
91.49 223 85.30 225 81.65 202 
91.13 241 85.27 203 81.51 230 
90.88 234 85.05 214 81.07 200 
90.83 226 84.58 176 80.95 200 
90.60 236 84.51 196 80.92 160 
90.30 250 84.51 207 80.84 205 
90.29 226 84.42 207 80.77 194 
89.93 233 84.34 211 80.72 196 
89.83 241 84.34 202 80.69 171 
89.65 234 84.13 229 80.58 201 
89.47 231 84.13 202 80.57 177 
88.87 228 84.09 184 80.10 192 
88.80 229 83.98 206 79.38 187 
88.66 235 83.93 202 78.75 161 
88.55 216 83.92 176 78.32 172 
88.43 207 83.73 204 78.17 163 
88.34 224 83.47 208 77.39 166 
87.95 237 83.27 211 76.30 170 
87.79 213 83.13 196 75.85 159 
87.01 215 83.05 203 75.60 154 
86.86 187 83.02 188 75.16 169 
86.85 204 82.82 169 74.85 159 
86.84 219 82.78 205 74.66 167 


(Continued ) 
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18. 


Source: Data provided courtesy of Dean Parmalee, M.D. and the Wright State University 
Statistical Consulting Center. 


Perform a complete regression analysis with AVG as the independent variable. Let a = .05 for 
all tests. 


Maria Mathias (A-13) conducted a study of hyperactive children. She measured the children's 
attitude, hyperactivity, and social behavior before and after treatment. The following table shows for 
3] subjects the age and improvement scores from pre-treatment to post-treatment for attitude (ATT), 
social behavior (SOC), and hyperactivity (HYP). A negative score for HYP indicates an improve- 
ment in hyperactivity; a positive score in ATT or SOC indicates improvement. Perform an analysis to 
determine if there is evidence to indicate that age (years) is correlated with any of the three outcome 
variables. Let о = .05 for all tests. 


Subject No. AGE ATT HYP SOC 


1 9 —1.2 —1.2 0.0 
2 9 0.0 0.0 1.0 
3 13 -0.4 0.0 0.2 
4 6 -0.4 —0.2 1.2 
5 9 1.0 —0.8 0.2 
6 8 0.8 0.2 0.4 
T 8 —0.6 —0.2 0.6 
8 9 1.2 0.8 0.6 
9 7 0.0 0.2 0.8 
10 12 0.4 —0.8 0.4 
11 9 —0.8 0.8 —0.2 
12 10 1.0 —0.8 1.2 
13 12 1.4 —1.6 0.6 
14 9 1.0 —0.2 —0.2 
15 12 0.8 —0.8 1.0 
16 9 1.0 0.4 0.4 
17 10 0.4 —0.2 0.6 
18 7 0.0 —0.4 0.6 
19 12 1.1 —0.6 0.8 
20 9 0.2 —0.4 0.2 
21 Я 0.4 —0.2 0.6 
22 6 0.0 —3.2 1.0 
23 11 0.6 —0.4 0.0 
24 11 0.4 —0.4 0.0 
25 11 1.0 —0.7 —0.6 
26 11 0.8 —0.8 0.0 


(Continued ) 
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Subject No. AGE ATT HYP SOC 


27 11 1.2 0.6 1.0 

28 11 0.2 0.0 —0.2 

29 11 0.8 -12 0.3 Source: Data provided courtesy 
30 8 00 00 _04 of Maria Mathias, М.О. and 

31 9 0.4 —0.2 02 the Wright State University 


Statistical Consulting Center. 


19. A study by Triller et al. (A-14) examined the length of time required for home health-care nurses to 
repackage a patient's medications into various medication organizers (i.e., pill boxes). For the 19 
patients in the study, researchers recorded the time required for repackaging of medications. They 
also recorded the number of problems encountered in the repackaging session. 


Repackaging Repackaging 

Patient No. No. of Problems Time (Minutes) Patient No. No. of Problems Time (Minutes) 

1 9 38 11 1 10 

2 2 25 12 2 15 

3 0 5 13 1 17 

4 6 18 14 0 18 

5 5 15 15 0 23 

6 3 25 16 10 29 

7 3 10 17 0 5 

8 1 5 18 1 22 

9 2 10 19 1 20 
10 0 15 


Source: Data provided courtesy of Darren M. Triller, Pharm.D. 


Perform a complete regression analysis of these data using the number of problems to predict the time 
it took to complete a repackaging session. Let a = .05 for all tests. What conclusions can be drawn 
from your analysis? How might your results be used by health-care providers? 


20. The following are the pulmonary blood flow (PBF) and pulmonary blood volume (PBV) values 
recorded for 16 infants and children with congenital heart disease: 


Y X 
PBV (ml/sqM) PBF (L/min/sqM) 
168 4.31 
280 3.40 
391 6.20 
420 17.30 
303 12.30 
429 13.99 
605 8.73 
522 8.90 
224 5.87 
291 5.00 
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21. 


22. 


Y X 

PBV (ml/sqM) PBF (L/min/sqM) 
233 3.51 

370 4.24 

531 19.41 

516 16.61 

211 7.21 

439 11.60 


Find the regression equation describing the linear relationship between the two variables, compute r, 
and test Но: В; = 0 by both the F test and the ¢ test. Let a = .05. 


Fifteen specimens of human sera were tested comparatively for tuberculin antibody by two methods. 
The logarithms of the titers obtained by the two methods were as follows: 
Method 

A (X) В (У) 

3.31 4.09 

2.41 3.84 

2.72 3.65 

2.41 3.20 

2.11 2.97 

2.11 3.22 

3.01 3.96 

2.13 2.76 

2.41 3.42 

2.10 3.38 

2.41 3.28 

2.09 2.93 

3.00 3.54 

2.08 3.14 

2.11 2.76 

Find the regression equation describing the relationship between the two variables, compute r^, and 
test Но: B, = 0 by both the F test and the 1 test. 

The following table shows the methyl mercury intake and whole blood mercury values in 12 subjects 
exposed to methyl mercury through consumption of contaminated fish: 

X Y 

Methyl Mercury in 

Mercury Intake whole blood 

(ug Hg/day) (ng/g) 

180 90 

200 120 

230 125 

410 290 


(Continued ) 
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X Y 
Methyl Mercury in 
Mercury Intake Whole Blood 
(ug Hg/day) (ng/g) 
600 310 
550 290 
275 170 
580 375 
105 70 
250 105 
460 205 
650 480 


Find the regression equation describing the linear relationship between the two variables, compute r, 
and test Но: В, = 0 by both the F and 1 tests. 


The following are the weights (kg) and blood glucose levels (mg/100 ml) of 16 apparently healthy 
adult males: 


Weight (X) Glucose (Y) 


64.0 108 
75.3 109 
73.0 104 
82.1 102 
76.2 105 
95.7 121 
59.4 79 
93.4 107 
82.1 101 
78.9 85 
76.7 99 
82.1 100 
83.9 108 
73.0 104 
64.4 102 
77.6 87 


Find the simple linear regression equation and test Но : В, = 0 using both ANOVA and the t test. Test 
Но: p = 0 and construct a 95 percent confidence interval for p. What is the predicted glucose level 
for a man who weighs 95 kg? Construct the 95 percent prediction interval for his weight. Let a = .05 
for all tests. 


The following are the ages (years) and systolic blood pressures of 20 apparently healthy adults: 


Age (X) BP (Y) Age (X) BP (Y) 


20 120 46 128 
43 128 53 136 
63 141 70 146 


(Continued ) 
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Age (X) BP (Y) Age (X) BP (Y) 


26 126 20 124 
53 134 63 143 
31 128 43 130 
58 136 26 124 
46 132 19 121 
58 140 31 126 
70 144 23 123 


Find the simple linear regression equation and test Но: 6; = 0 using both ANOVA and the 1 test. 
Test Но: p = 0 and construct а 95 percent confidence interval for р. Find the 95 percent 
prediction interval for the systolic blood pressure of a person who is 25 years old. Let o = .05 
for all tests. 


The following data were collected during an experiment in which laboratory animals were 
inoculated with a pathogen. The variables are time in hours after inoculation and temperature in 
degrees Celsius. 

Time Temperature Time Temperature 

24 38.8 44 41.1 

28 39.5 48 41.4 

32 40.3 52 41.6 

36 40.7 56 41.8 

40 41.0 60 41.9 


Find the simple linear regression equation and test Но : В, = O using both ANOVA and the t test. Test 
Но: p = 0 and construct а 95 percent confidence interval for p. Construct the 95 percent prediction 
interval for the temperature at 50 hours after inoculation. Let о = .05 for all tests. 


For each of the studies described in Exercises 26 through 28, answer as many of the following 
questions as possible. 


(a) Which is more relevant, regression analysis or correlation analysis, or are both techniques 
equally relevant? 


(b) Which is the independent variable? 

(c) Which is the dependent variable? 

(d) What are the appropriate null and alternative hypotheses? 

(e) Do you think the null hypothesis was rejected? Explain why or why not. 


(f) Which is the more relevant objective, prediction or estimation, or are the two equally 
relevant? 


(g) What is the sampled population? 

(h) What is the target population? 

(i) Are the variables directly or inversely related? 

Lamarre-Cliche et al. (A-15) state, “The QT interval corrected for heart rate (ОТс) is believed to 
reflect sympathovagal balance. It has also been established that 8-blockers influence the autonomic 


nervous system." The researchers performed correlation analysis to measure the association between 
QTc interval, heart rate, heart rate change, and therapeutic blood pressure response for 73 


27. 


28. 


29. 
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hypertensive subjects taking 6-blockers. The researchers found that QTc interval length, pretreat- 
ment heart rate, and heart rate change with therapy were not good predictors of blood pressure 
response to B1-selective -blockers in hypertensive subjects. 


Skinner et al. (A-16) conducted a cross-sectional telephone survey to obtain 24-hour dietary recall of 
infants’ and toddlers’ food intakes, as reported by mothers or other primary caregivers. One finding 
of interest was that among 561 toddlers ages 15—24 months, the age in weeks of the child was 
negatively related to vitamin C density B 1 = —.43, р = .01. When predicting calcium density, age in 
weeks of the child produced a slope coefficient of —1.47 with a p of .09. 


Park et al. (A-17) studied 29 male subjects with clinically confirmed cirrhosis. Among other 
variables, they measured whole blood manganese levels (MnB), plasma manganese (MnP), urinary 
manganese (MnU), and pallidal index (PI), a measure of signal intensity in Т1 weighted magnetic 
resonance imaging (MRI). They found a correlation coefficient of .559, p < .01, between MnB and 
PI. However, there were no significant correlations between MnP and Pi or MnU and Pi (r — .353, 
p > 05, r = 252, p > .05, respectively). 


For the studies described in Exercises 29 through 46, do the following: 

(a) Perform a statistical analysis of the data (including hypothesis testing and confidence interval 
construction) that you think would yield useful information for the researchers. 

(b) Construct graphs that you think would be helpful in illustrating the relationships among 
variables. 

(c) Where you think appropriate, use techniques learned in other chapters, such as analysis of 
variance and hypothesis testing and interval estimation regarding means and proportions. 


(d) Determine p values for each computed test statistic. 

(e) State all assumptions that are necessary to validate your analysis. 

(f) Describe the population(s) about which you think inferences based on your analysis would be 
applicable. 

(g) If available, consult the cited reference and compare your analyses and results with those of the 
authors. 


Moerloose et al. (A-18) conducted a study to evaluate the clinical usefulness of a new laboratory 
technique (method A) for use in the diagnosis of pulmonary embolism (PE). The performance of 
the new technique was compared with that of a standard technique (method B). Subjects 
consisted of patients with clinically suspected PE who were admitted to the emergency ward of a 
European university hospital. The following are the measurements obtained by the two 
techniques for 85 patients. The researchers performed two analyses: (1) on all 85 pairs of 
measurements and (2) on those pairs of measurements for which the value for method B was less 
than 1000. 


B A B A B A 
9 119 703 599 2526 1830 
84 115 725 610 2600 1880 
86 108 727 3900 2770 2100 
190 182 745 4050 3100 1780 
208 294 752 785 3270 1870 
218 226 884 914 3280 2480 
251 311 920 1520 3410 1440 
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252 
256 
264 
282 
294 
296 
311 
344 
371 
407 
418 
422 
459 
468 
481 
529 
540 
562 
574 
646 
664 
670 


250 
312 
403 
296 
296 
303 
336 
333 
257 
424 
265 
347 
412 
389 
414 
667 
486 
720 
343 
518 
801 
760 


3530 2190 
3900 2340 
4260 3490 
4300 4960 
4560 7180 
4610 1390 
4810 1600 
5070 3770 
5470 2780 
5576 2730 
6230 1260 
6260 2870 
6370 2210 
6430 2210 
6500 2380 
7120 5220 
7430 2650 
7800 4910 
8890 4080 
9930 3840 


Source: Data provided courtesy of Dr. Philippe de Moerloose. 


Research by Huhtaniemi et al. (A-19) focused on the quality of serum luteinizing hormone (LH) during 
pubertal maturation in boys. Subjects, consisting of healthy boys entering puberty (ages 11 years 
5 months to 12 years), were studied over a period of 18 months. The following are the concentrations 
(IU/L) of bioactive LH (B-LH) and immunoreactive LH (1-LH) in serum samples taken from the 
subjects. Only observations in which the subjects” B/I ratio was greater than 3.5 are reported here. 


LLH B-LH LLH B-LH 
.104 37 97 3.63 
041 28 49 2.26 
124 .64 1 4.55 
.808 2.32 1.17 5.06 
.403 1.28 1.46 4.81 
21 9 1.97 8.18 
49 2.45 88 2.48 
‚66 2.8 1.24 4.8 
.82 2.6 1.54 3.12 

1.09 4.5 1.71 8.4 

1.05 32 1.11 6 
.83 3.65 1.35 T2 
.89 5.25 1.59 7.6 
75 2.9 


Source: Data provided courtesy of Dr. Про T. Huhtaniemi. 
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Tsau et al. (A-20) studied urinary epidermal growth factor (EGF) excretion in normal children and 
those with acute renal failure (ARF). Random urine samples followed by 24-hour urine collection 
were obtained from 25 children. Subjects ranged in age from 1 month to 15 years. Urinary EGF 
excretion was expressed as a ratio of urinary EGF to urinary creatinine concentration (EGF/Cr). The 
authors conclude from their research results that it is reasonable to use random urine tests for 
monitoring EGF excretion. Following are the random (spot) and 24-hour urinary EGF/Cr concen- 
trations (pmol/mmol) for the 25 subjects: 


24-h Urine Spot Urine 24-h Urine Spot Urine 
Subject EGF/Cr (x) EGF/Cr (y) Subject EGF/Cr (x) EGF/Cr (y) 
1 772 720 14 254 333 
2 223 271 15° 93 84 
3 494 314 16 303 512 
4 432 350 17 408 2TI 
se 79 79 18 711 443 
6* 155 118 19 209 309 
7 305 387 20 131 280 
8 318 432 21 165 189 
9* 174 97 22 151 101 
10 1318 1309 23 165 221 
11 482 406 24 125 228 
12 436 426 25 232 157 
13 527 595 


“Subjects with АВЕ 
Source: Data provided courtesy of Dr. Yong-Kwei Tsau. 


One of the reasons for a study by Usaj and Starc (A-21) was an interest in the behavior of pH kinetics 
during conditions of long-term endurance and short-term endurance among healthy runners. The nine 
subjects participating in the study were marathon runners aged 26 - 5 years. The authors report that 
they obtained a good correlation between pH kinetics and both short-term and long-term endurance. 
The following are the short- (Ук) and long-term (V; к) speeds and blood pH measurements for the 
participating subjects. 


Vig Усе pH Range 

5.4 5.6 .083 

4.75 5.1 1 

4.6 4.6 .021 

4.6 5 .065 

4.55 4.9 056 

44 4.6 01 

44 4.9 .058 

4.2 44 013 Source: Data provided courtesy 
4.2 4.5 .03 of Anton Usaj, Ph.D. 


Bean et al. (A-22) conducted a study to assess the performance of the isoelectric focusing/ 
immunoblotting/laser densitometry (IEF/IB/LD) procedure to evaluate carbohydrate-deficient trans- 
ferrin (CDT) derived from dry blood spots. The investigators evaluated paired serum (S) and dry 
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blood spot (DBS) specimens simultaneously for CDT. Assessment of CDT serves as a marker for 
alcohol abuse. The use of dry blood spots as a source of CDT for analysis by IEF/IB/LD results in 
simplified sampling, storage, and transportation of specimens. The following are the IEF/IB/LD 


values in densitometry units (DU) of CDT from 25 serum and dry blood spot specimens: 
Specimen No. 5 DBS | Specimen No. 5 DBS 

1 64 23 14 9 13 

2 74 38 15 10 8 

3 75 37 16 17 7 

4 103 53 17 38 14 

5 10 9 18 9 9 

6 22 18 19 15 9 

7 33 20 20 70 31 

8 10 5 21 61 26 

9 31 14 22 42 14 
10 30 15 23 20 10 
11 28 12 24 58 26 
12 16 9 25 31 12 Source: Data provided courtesy 
13 13 7 of Dr. Pamela Bean. 


Kato et al. (A-23) measured the plasma concentration of adrenomedullin (AM) in patients with 
chronic congestive heart failure due to various cardiac diseases. AM is a hypotensive peptide, which, 
on the basis of other studies, the authors say, has an implied role as a circulating hormone in 
regulation of the cardiovascular system. Other data collected from the subjects included plasma 
concentrations of hormones known to affect the cardiovascular system. Following are the plasma AM 
(fmol/ml) and plasma renin activity (PRA) (ng/L---s) values for 19 heart failure patients: 


Patient Sex Age AM PRA 
No. (1=M,2=F) (Years)  (fmol/ml  (ng/L---s) 
1 1 70 12.11 480594 
2 1 44 7.306 .63894 
3 1 72 6.906 1.219542 
4 1 62 7.056 450036 
5 2 52 9.026 .19446 
6 p 65 10.864 1.966824 
7 2 64 7.324 .29169 
8 1 71 9.316 1.775142 
9 2 61 17.144 9.33408 
10 1 68 6.954 .31947 
11 1 63 7.488 1.594572 
12 2 59 10.366 ‚963966 
13 2 55 10.334 2.191842 
14 2 57 13 3.97254 
15 2 68 6.66 .52782 
16 2 51 8.906 .350028 
17 1 69 8.952 1.73625 
18 1 71 8.034 102786 Source: Data provided 
19 1 46 13.41 1.13898 


courtesy of Dr. Johji Kato. 


REVIEW QUESTIONS AND EXERCISES 475 


In a study reported on in Archives of Disease in Childhood, Golden et al. (A-24) tested the hypothesis 
that plasma calprotectin (PCal) (a neutrophil cytosolic protein released during neutrophil activation 
or death) concentration is an early and sensitive indicator of inflammation associated with bacterial 
infection in cystic fibrosis (CF). Subjects were children with confirmed CF and a control group of 
age- and sex-matched children without the disease. Among the data collected were the following 
plasma calprotectin (ug/L) and plasma copper (PCu) (mol/L) measurements. Plasma copper is an 
index of acute phase response in cystic fibrosis. The authors reported a correlation coefficient of .48 
between plasma calprotectin (log;o) and plasma copper. 


CF CF CF 

Subject Subject Subject 

No. PCal PCu No. PCal PCu No. PCal PCu 
1 452 17.46 12 1548 15.31 22 674 18.11 
2 590 14.84 13 708 17.00 23 3529 17.42 
3 1958 27.42 14 8050 20.00 24 1467 17.42 
4 2015 18.51 15 9942 25.00 25 1116 16.73 
5 417 15.89 16 791 13.10 26 611 18.11 
6 2884 17.99 17 6227 23.00 27 1083 21.56 
7 1862 21.66 18 1473 16.70 28 1432 21.56 
8 10471 19.03 19 8697 18.11 29 4422 22.60 
9 25850 16.41 20 621 18.80 30 3198 18.91 

10 5011 18.51 21 1832 17.08 31 544 14.37 

11 5128 22.70 

Control Control 

Subject Subject 

No. PCal PCu No. PCal PCu 
1 674 16.73 17 368 16.73 
2 368 16.73 18 674 16.73 
3 321 16.39 19 815 19.82 
4 1592 14.32 20 598 16.1 
5 518 16.39 21 684 13.63 
6 815 19.82 22 684 13.63 
7 684 17.96 23 674 16.73 
8 870 19.82 24 368 16.73 
9 781 18.11 25 1148 24.15 

10 727 18.11 26 1077 22.30 

11 727 18.11 27 518 9.49 

12 781 18.11 28 1657 16.10 

13 674 16.73 29 815 19.82 

14 1173 20.53 30 368 16.73 

15 815 19.82 31 1077 22.30 

16 727 18.11 


Source: Data provided courtesy of Dr. Barbara E. Golden. 
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Gelb et al. (A-25) conducted a study in which they explored the relationship between moderate to 
severe expiratory airflow limitation and the presence and extent of morphologic and CT scored 
emphysema in consecutively seen outpatients with chronic obstructive pulmonary disease. Among 
the data collected were the following measures of lung CT and pathology (PATH) for emphysema 
scoring: 


CT Score PATH CT Score PATH 

5 15 45 50 
90 70 45 40 
50 20 85 75 
10 25 7 0 
12 25 80 85 
35 10 15 5 
40 35 45 40 
45 30 37 35 

5 5 75 45 
25 50 5 5 
60 60 5 20 
70 60 


Source: Data provided courtesy of Dr. Arthur F. Gelb. 


The objective of a study by Witteman et al. (A-26) was to investigate skin reactivity with purified 
major allergens and to assess the relation with serum levels of immunoglobulin E (IgE) antibodies 
and to determine which additional factors contribute to the skin test result. Subjects consisted of 
patients with allergic rhinitis, allergic asthma, or both, who were seen in a European medical 
center. As part of their study, the researchers collected, from 23 subjects, the following 
measurements on specific IgE (IU/ml) and skin test (ng/ml) in the presence of Lol p 5, a purified 
allergen from grass pollen. We wish to know the nature and strength of the relationship between 
the two variables. (Note: The authors converted the measurements to natural logarithms before 
investigating this relationship.) 


IgE Skin Test 
24.87 .055 
12.90 .041034 
9.87 .050909 
8.74 .046 
6.88 .039032 
5.90 .050909 
4.85 .042142 
3.53 .055 
2:25 4.333333 
2.14 .55 
1.94 .050909 
1.29 .446153 
94 4 
91 475 
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IgE Skin Test 
.55 4.461538 
.30 4.103448 
14 7.428571 
11 4.461538 
10 6.625 
10 49.13043 
10 36.47058 
10 52.85714 
10 47.5 


Source: Data provided courtesy 
of Dr. Jaring S. van der Zee. 
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Garland et al. (A-27) conducted a series of experiments to delineate the complex maternal-fetal 
pharmacokinetics and the effects of zidovudine (AZT) in the chronically instrumented maternal and 
fetal baboon (Papio species) during both steady-state intravenous infusion and oral bolus dosage 
regimens. Among the data collected were the following measurements on dosage (mg/kg/h) and 
steady-state maternal plasma AZT concentration (ng/ml): 


AZT AZT 
Dosage Concentration Dosage Concentration 
2.5 832 2.0 TI 
2:5 672 1.8 757 
2.5 904 0.9 213 
25 554 0.6 394 
2.5 996 0.9 391 
1.9 878 1.3 430 
2.1 815 1.1 440 
1.9 805 1.4 352 
1.9 592 1.1 337 
0.9 39] 0.8 181 
1.5 710 0.7 174 
1.4 591 1.0 470 
1.4 660 1.1 426 
1.5 694 0.8 170 
1.8 668 1.0 360 
1.8 601 0.9 320 


Source: Data provided courtesy of Dr. Marianne Garland. 


The purpose of a study by Halligan et al. (A-28) was to evaluate diurnal variation in blood 
pressure (BP) in women who were normotensive and those with pre-eclampsia. The subjects 
were similar in age, weight, and mean duration of gestation (35 weeks). The researchers 
collected the following BP readings. As part of their analysis they studied the relationship 
between mean day and night measurements and day/night differences for both diastolic and 


systolic BP in each group. 
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A 
ма 


C2 C3 C4 C5 C1 C2 C3 C4 C5 


75 56 127 101 
68 57 113 104 
72 58 115 105 
71 51 111 94 
81 61 130 110 
68 56 111 101 
78 60 113 102 
71 55 120 99 
65 51 106 96 
78 61 120 109 
74 60 121 104 
75 52 121 102 
68 50 109 91 
63 49 108 99 
77 47 132 115 
73 51 112 90 
73 52 118 97 
64 62 122 114 
64 54 108 94 
66 54 106 88 
72 49 116 101 
83 60 127 103 
69 50 121 104 
72 32 108 95 


94 78 137 119 
90 86 139 138 
85 69 138 117 
80 75 133 126 
81 60 127 112 
89 79 137 126 
107 110 161 161 
98 88 152 141 
78 74 134 132 
80 80 121 121 
96 83 143 129 
85 76 137 131 
79 74 135 120 
91 95 139 135 
87 67 137 115 
83 64 143 119 
94 85 127 123 
85 70 142 124 
78 61 119 110 
80 59 129 114 
98 102 156 163 
100 100 149 149 
89 84 141 135 
98 91 148 139 


oco00o00o0o0o000000000000000000o00o00> 
Rath hp ыз шш ыы шыш ыы шш ы 


С1 = group (0 = normotensive, 1 = pre-eclamptic); C2 = day diastolic; C3 — night diastolic; 
СА = day systolic; C5 = night systolic. 
Source: Data provided courtesy of Dr. Aidan Halligan. 


Marks et al. (A-29) conducted a study to determine the effects of rapid weight loss on contraction of 
the gallbladder and to evaluate the effects of ursodiol and ibuprofen on saturation, nucleation and 
growth, and contraction. Subjects were obese patients randomly assigned to receive ursodiol, 
ibuprofen, or placebo. Among the data collected were the following cholesterol saturation index 
values (CSI) and nucleation times (NT) in days of 13 (six male, seven female) placebo-treated 
subjects at the end of 6 weeks: 


CSI NT 
1.20 4.00 
1.42 6.00 
1.18 14.00 
.88 21.00 
1.05 21.00 
1.00 18.00 
1.39 6.00 
1.31 10.00 
1.17 9.00 
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CSI NT 

1.36 14.00 
1.06 21.00 
1.30 8.00 
1.71 2.00 


Source: Data provided courtesy 
of Dr. Jay W. Marks. 


The objective of a study by Peacock et al. (A-30) was to investigate whether spinal osteoarthritis is 
responsible for the fact that lumbar spine bone mineral density (BMD) is greater when measured in 
the anteroposterior plane than when measured in the lateral plane. Lateral spine radiographs were 
studied from women (age range 34 to 87 years) who attended a hospital outpatient department for 
bone density measurement and underwent lumbar spine radiography. Among the data collected were 
the following measurements on anteroposterior (A) and lateral (L) BMD (g/cm?): 


ABMD LBMD ABMD LBMD ABMD LBMD 
.879 SU 1.098 .534 1.091 .836 
.824 .622 .882 .570 .746 433 
.974 .643 .816 .558 1.127 732 
.909 .664 1.017 .675 1.411 766 
.872 .559 .669 .590 751 .397 
.930 .663 857 .666 .786 515 
912 .710 571 474 1.031 574 
758 .592 1.134 711 .622 .506 

1.072 1702 1705 .492 .848 .657 
.847 .655 775 .348 778 .537 

1.000 .518 .968 .579 .784 419 
.565 .354 .963 .665 .659 .429 

1.036 .839 .933 .626 .948 .485 
811 572 .704 .194 .634 .544 
.901 .612 .624 .429 .946 .550 

1.052 .663 1.119 107 1.107 .458 
731 .376 .686 .508 1.583 .975 
.637 488 741 484 1.026 550 
951 747 1.028 787 
.822 .610 .649 .469 
.951 1710 1.166 796 

1.026 .694 .954 .548 

1.022 .580 .666 545 

1.047 1706 
1737 .526 


Source: Data provided courtesy of Dr. Cyrus Cooper. 


Sloan et al. (A-31) note that cardiac sympathetic activation and parasympathetic withdrawal result in 
heart rate increases during psychological stress. As indicators of cardiac adrenergic activity, plasma 
epinephrine (E) and norepinephrine (NE) generally increase in response to psychological challenge. 
Power spectral analysis of heart period variability also provides estimates of cardiac autonomic 
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nervous system activity. The authors conducted a study to determine the relationship between 
neurohumoral and two different spectral estimates of cardiac sympathetic nervous system activity 
during a quiet resting baseline and in response to a psychologically challenging arithmetic task. 
Subjects were healthy, medication-free male and female volunteers with a mean age of 37.8 years. 
None had a history of cardiac, respiratory, or vascular disease. Among the data collected were the 
following measurements on E, NE, low-frequency (LF) and very-low-frequency (VLF) power 
spectral indices, and low-frequency/high frequency ratios (LH/HF). Measurements are given for 
three periods: baseline (B), a mental arithmetic task (MA), and change from baseline to task 


(DELTA). 

Patient No. E NE LF/HF LF Period VLF 

3 3.55535 6.28040 0.66706 7.71886 В 7.74600 
5 0.05557 0.13960 —0.48115 —0.99826 DELTA —2.23823 
5 3.61092 6.41999 0.18591 6.72059 MA 5.50777 
6 3.55535 6.24611 2.48308 7.33729 B 6.64353 
6 0.10821 —0.05374 —2.03738 —0.77109 DELTA — 1.27196 
6 3.66356 6.19236 0.44569 6.56620 MA 5.37157 
7 3.20584 4.91998 —0.15473 7.86663 В 7.99450 
7 0.59598 0.53106 0.14086 —0.81345 DELTA — 2.86401 
7 3.89182 5.45104 —0.01387 7.05319 MA 5.13049 
8 4.00733 5.97635 1.58951 8.18005 B 5.97126 
8 0.29673 0.11947 —0.11771 — 1.16584 DELTA —0.39078 
8 4.30407 6.09582 1.47180 7.01421 MA 5.58048 
12 3.87120 5.35659 0.47942 6.56488 B 5.94960 
12 * * 0.19379 0.03415 DELTA 0.50134 
12 * * 0.67321 6.59903 MA 6.45094 
13 3.97029 5.85507 0.13687 6.27444 В 5.58500 
13 —0.20909 0.10851 1.05965 —0.49619 DELTA — 1.68911 
13 3.76120 5.96358 1.19652 5.71825 MA 3.89589 
14 3.63759 5.62040 0.88389 6.08877 B 6.12490 
14 0.31366 0.07333 1.06100 1.37098 DELTA — 1.07633 
14 3.95124 5.69373 1.94489 7.45975 МА 5.04857 
18 4.44265 5.88053 0.99200 7.52268 В 7.19376 
18 0.35314 0.62824 —0.10297 —0.57142 DELTA —2.06150 
18 4.79579 6.50877 0.88903 6.95126 МА 5.13226 
19 * 5.03044 0.62446 6.90677 В 7.39854 
19 * 0.69966 0.09578 0.94413 DELTA —0.88309 
19 2.94444 5.73010 0.72024 7.85090 MA 6.51545 
20 3.91202 5.86363 1.11825 8.26341 B 6.89497 
20 —0.02020 0.21401 —0.60117 — 1.13100 DELTA — 1.12073 
20 3.89182 6.07764 0.51708 7.13241 MA 5.77424 
21 3.55535 6.21860 0.78632 8.74397 В 8.26111 
21 0.31585 —0.52487 — 1.92114 —2.38726 DELTA —2.08151 
21 3.87120 5.69373 — 1.13483 6.35671 MA 6.17960 
22 4.18965 5.76832 —0.02785 8.66907 B 7.51529 
22 0.16705 —0.05459 0.93349 —0.89157 DELTA — 1.00414 
22 4.35671 5.71373 0.90563 7.77751 MA 6.51115 
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Patient No. 


23 
23 
23 


E 


3.95124 
0.26826 
4.21951 
3.78419 
0.32668 
4.11087 
3.36730 
0.54473 
3.91202 
2.83321 
1.15577 
3.98898 
4.29046 
0.14036 
4.43082 
3.93183 
0.80437 
4.73620 
3.29584 
—0.16034 
3.13549 
3.25810 
0.40547 
3.66356 
3.78419 
0.64663 
4.43082 
4.07754 
0.23995 
4.31749 
4.33073 
—3.63759 
0.69315 
3.55535 
0.13353 
3.68888 
3.33220 
1.16761 
4.49981 
3.25810 
* 
* 
5.42935 
* 
* 
4.11087 
—0.06782 


NE 


5.52545 
0.16491 
5.69036 
5.59842 
—0.17347 
5.42495 
6.13123 
0.08538 
6.21661 
5.92158 
0.64930 
6.57088 
5.73657 
0.47000 
6.20658 
5.627762 
0.67865 
6.30628 
5.47227 
0.27073 
5.74300 
5.37064 
—0.13953 
5.23111 
5.94542 
0.05847 
6.00389 
5.87493 
—0.00563 
5.86930 
5.84064 
—0.01464 
5.82600 
6.04501 
0.12041 
6.16542 
4.63473 
1.05563 
5.69036 
5.96358 
* 
* 
6.34564 
* 
* 
6.59441 
—0.54941 


LF/HF 


—0.24196 
—0.00661 
—0.24856 
—0.67478 
1.44970 
0.77493 
0.19077 
0.79284 
0.98361 
1.89472 
—0.75686 
1.13786 
1.81816 
—0.26089 
1.55727 
1.70262 
—0.26531 
1.43731 
0.18852 
— 0.16485 
0.02367 
— 0.09631 
0.97906 
0.88274 
0.77839 
—0.42774 
0.35066 
2.32137 
—0.25309 
2.06827 
2.89058 
—1.22533 
1.66525 
1.92977 
—0.15464 
1.77513 
—0.11940 
0.85621 
0.73681 
1.10456 
0.26353 
1.36809 
2.76361 
—1.14662 
1.61699 
—0.23319 
0.34755 


LF 


6.75330 
0.18354 
6.93684 
6.26453 
0.52169 
6.78622 
6.75395 
0.34637 
7.10031 
7.92524 
—1.58481 
6.34042 
7.02734 
—1.08028 
5.94705 
6.76859 
—0.29394 
6.47465 
6.49054 
—1.12558 
5.36496 
7.23131 
—0.62894 
6.60237 
5.86126 
—0.53530 
5.32595 
6.71736 
—0.00873 
6.70863 
7.22570 
—1.33514 
5.89056 
8.50684 
—0.84735 
7.65949 
6.35464 
0.63251 
6.98716 
7.01270 
—1.20066 
5.81204 
9.48594 
—1.58468 
7.90126 
6.68269 
—0.29398 


Period 


B 
DELTA 


VLF 


6.93020 
— 1.18912 
5.74108 
6.45268 
0.39277 
6.84545 
6.13708 
—0.56569 
5.57139 
6.30664 
— 1.95636 
4.35028 
7.02882 
— 1.43858 
5.59024 
6.11102 
—0.94910 
5.16192 
6.84279 
— 1.84288 
4.99991 
7.16371 
—2.15108 
5.01263 
6.22910 
—2.18430 
4.04480 
6.59769 
—0.75357 
5.84412 
5.76079 
—0.55240 
5.20839 
7.15797 
0.13525 
7.29322 
6.76285 
—0.52121 
6.24164 
7.49426 
—3.15046 
4.34381 
7.05730 
—0.08901 
6.96829 
6.76872 
— 1.80868 
(Continued ) 
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Patient No. E NE LF/HF LF Period VLF 

16 4.04305 6.04501 0.11437 6.38871 MA 4.96004 
17 * 6.28040 1.40992 6.09671 B 4.82671 
17 * —0.12766 —0.17490 — 0.05945 DELTA 0.69993 
17 * 6.15273 1.23501 6.03726 MA 5.52665 
18 2.39790 6.03548 0.23183 6.39707 B 6.60421 
18 1.06784 0.11299 0.27977 —0.38297 DELTA — 1.92672 
18 3.46574 6.14847 0.51160 6.01410 MA 4.67749 
19 4.21951 6.35784 1.08183 5.54214 В 5.69070 
19 0.21131 —0.00347 0.12485 —0.54440 DELTA — 1.49802 
19 4.43082 6.35437 1.20669 4.99774 МА 4.19268 
20 4.14313 5.73334 0.89483 7.35045 В 6.93974 
20 —0.11778 0.00000 0.17129 —0.58013 DELTA — 1.72916 
20 4.02535 5.73334 1.06612 6.77032 МА 5.21058 
21 3.66356 6.06843 —0.87315 5.09848 В 6.02972 
21 0.20764 —0.10485 0.41178 —0.33378 DELTA —2.00974 
21 3.87120 5.96358 —0.46137 4.76470 MA 4.01998 
22 3.29584 5.95324 2.38399 7.62877 В 7.54359 
22 0.36772 0.68139 —0.75014 —0.89992 DELTA —1.25555 
22 3.66356 6.63463 1.63384 6.72884 MA 6.28804 


* = missing data. 
Source: Data provided courtesy of Dr. Richard P. Sloan. 


The purpose of a study by Chati et al. (A-32) was to ascertain the role of physical deconditioning in 
skeletal muscle metabolic abnormalities in patients with chronic heart failure (CHF). Subjects 
included ambulatory CHF patients (12 males, two females) ages 35 to 74 years. Among the data 
collected were the following measurements, during exercise, of workload (WL) under controlled 
conditions, peak oxygen consumption (Vo), anaerobic ventilatory threshold (AT), both measured in 
ml/kg/min, and exercise total time (ET) in seconds. 


WL Vo; AT ET WL Vo; AT ET 

7.557 32.800 13.280 933.000 3.930 22.500 18.500 720.000 
3.973 8.170 6.770 255.000 3.195 17.020 8.520 375.000 
5.311 16.530 11.200 480.000 2.418 15.040 12.250 480.000 
5.355 15.500 10.000 420.000 0.864 7.800 4.200 240.000 
6.909 24.470 11.550 960.000 2.703 12.170 8.900 513.000 
1.382 7.390 5.240 346.000 1.727 15.110 6.300 540.000 
8.636 19.000 10.400 600.000 7773 21.100 12.500 1200.000 


Source: Data provided courtesy of Dr. Zukai Chati. 


Czader et al. (A-33) investigated certain prognostic factors in patients with centroblastic- 
centrocytic non-Hodgkin's lymphomas (CB/CC NHL). Subjects consisted of men and women 
between the ages of 20 and 84 years at time of diagnosis. Among the data collected were the 
following measurements on two relevant factors, A and B. The authors reported a significant 
correlation between the two. 


45. 


REVIEW QUESTIONS AND EXERCISES 483 


A B A B A B 
20.00 .154 22.34 147 48.66 .569 
36.00 .221 18.00 .132 20.00 .227 
6.97 .129 18.00 .085 17.66 .125 
13.67 .064 22.66 577 14.34 .089 
36.34 .402 45.34 .134 16.33 .051 
39.66 .256 20.33 2246 18.34 .100 
14.66 .188 16.00 .175 26.49 .202 
277.00 .138 15.66 .105 13.33 ‚077 
2.66 078 23.00 .145 6.00 .206 
22.00 .142 27.33 .129 15.67 .153 
11.00 .086 6.27 .062 32.33 .549 
20.00 .170 24.34 .147 
22.66 .198 22.33 169 
7.34 092 11.33 .130 
29.67 .227 6.67 .099 
11.66 .159 
8.05 .223 
22.66 .065 


Source: Data provided courtesy of Dr. Magdalena Czader and Dr. Anna Porwit-MacDonald. 


Fleroxacin, a fluoroquinolone derivative with a broad antibacterial spectrum and potent activity in 
vitro against gram-negative and many gram-positive bacteria, was the subject of a study by Reigner 
and Welker (A-34). The objectives of their study were to estimate the typical values of clearance over 
systemic availability (CL/F) and the volume of distribution over systemic availability (V/F) after the 
administration of therapeutic doses of fleroxacin and to identify factors that influence the disposition 
of fleroxacin and to quantify the degree to which they do so. Subjects were 172 healthy male and 
female volunteers and uninfected patients representing a wide age range. Among the data analyzed 
were the following measurements (ml/min) of CL/F and creatinine clearance (CLcr). According to 
the authors, previous studies have shown that there is a correlation between the two variables. 


CL/F CLer CL/F CLer CL/F CLer CL/F CLer 
137.000 96.000 77.000 67.700 152.000 109.000 132.000 111.000 
106.000 83.000 57.000 51.500 100.000 82.000 94.000 118.000 
165.000 100.000 69.000 52.400 86.000 88.000 90.000 111.000 
127.000 101.000 69.000 65.900 69.000 67.000 87.000 124.000 
139.000 116.000 76.000 60.900 108.000 68.700 48.000 10.600 
102.000 78.000 77.000 93.800 77.000 83.200 26.000 9.280 
72.000 84.000 66.000 73.800 85.000 72.800 54.000 12.500 
86.000 81.000 53.000 99.100 89.000 82.300 36.000 9.860 
85.000 77.000 26.000 110.000 105.000 71.100 26.000 4.740 
122.000 102.000 89.000 99.900 66.000 56.000 39.000 7.020 
76.000 80.000 44.000 73.800 73.000 61.000 27.000 6.570 
57.000 67.000 27.000 65.800 64.000 79.500 36.000 13.600 
62.000 41.000 96.000 109.000 26.000 9.120 15.000 7.600 
90.000 93.000 102.000 76.800 29.000 8.540 138.000 100.000 


(Continued ) 
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CL/F CLer CL/F CLer CL/F CLer CL/F CLer 
165.000 88.000 159.000 125.000 39.100 93.700 127.000 108.000 
132.000 64.000 115.000 112.000 75.500 65.600 203.000 121.000 
159.000 92.000 82.000 91.600 86.000 102.000 198.000 143.000 
148.000 114.000 96.000 83.100 106.000 105.000 151.000 126.000 
116.000 59.000 121.000 88.800 77.500 67.300 113.000 111.000 
124.000 67.000 99.000 94.000 87.800 96.200 139.000 109.000 
76.000 56.000 120.000 91.500 25.700 6.830 135.000 102.000 
40.000 61.000 101.000 83.800 89.700 74.800 116.000 110.000 
23.000 35.000 118.000 97.800 108.000 84.000 148.000 94.000 
27.000 38.000 116.000 100.000 58.600 79.000 221.000 110.000 
64.000 79.000 116.000 67.500 91.700 68.500 115.000 101.000 
44.000 64.000 87.000 97.500 48.900 20.600 150.000 110.000 
59.000 94.000 59.000 45.000 53.500 10.300 135.000 143.000 
47.000 96.000 96.000 53.500 41.400 11.800 201.000 115.000 
17.000 25.000 163.000 84.800 24.400 7.940 164.000 103.000 
67.000 122.000 39.000 73.700 42.300 3.960 130.000 103.000 
25.000 43.000 73.000 87.300 34.100 12.700 162.000 169.000 
24.000 22.000 45.000 74.800 28.300 7.170 107.000 140.000 
65.000 55.000 94.000 100.000 47.000 6.180 78.000 87.100 
69.000 42.500 74.000 73.700 30.500 9.470 87.500 134.000 
55.000 71.000 70.000 64.800 38.700 13.700 108.000 108.000 
39.000 34.800 129.000 119.000 60.900 17.000 126.000 118.000 
58.000 50.300 34.000 30.000 51.300 6.810 131.000 109.000 
37.000 38.000 42.000 65.900 46.100 24.800 94.400 60.000 
32.000 32.000 48.000 34.900 25.000 7.200 87.700 82.900 
66.000 53.500 58.000 55.900 29.000 7.900 94.000 99.600 
49.000 60.700 30.000 40.100 25.000 6.600 157.000 123.000 
40.000 66.500 47.000 48.200 40.000 8.600 
34.000 22.600 35.000 14.800 28.000 5.500 
87.000 61.800 20.000 14.400 


Source: Data provided courtesy of Dr. Bruno Reigner. 


Yasu et al. (A-35) used noninvasive magnetic resonance spectroscopy to determine the short- and 
long-term effects of percutaneous transvenous mitral commissurotomy (PTMC) on exercise 
capacity and metabolic responses of skeletal muscles during exercise. Data were collected on 
11 patients (2 males, 9 females) with symptomatic mitral stenosis. Their mean age was 52 years 
with a standard deviation of 11. Among the data collected were the following measurements on 
changes in mitral valve area (d-MVA) and peak oxygen consumption (4-У02) 3, 30, and 90 days 


post-PTMC: 
Days d-Vo, 
Subject Post-PTMC d-MVA (cm?) (ml/kg/min) 
1 3 0.64 0.3 
2 3 0.76 —0.9 
3 3 0.3 1.9 
4 3 0.6 —3.1 
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Days d-Vo; 
Subject Post-PTMC d-MVA (cm?) (ml/kg/min) 
5 3 0.3 —0.5 
6 3 0.4 -2.] 
7 3 0.7 1.5 
8 3 0.9 1.1 
9 3 0.6 —14 
10 3 0.4 —0.4 
11 3 0.65 3.8 
1 30 0.53 1.6 
2 30 0.6 33 
3 30 04 2.6 
4 30 0.5 ж 
5 30 0.3 3.6 
6 30 0.3 0.2 
7 30 0.67 42 
8 30 0.75 3 
9 30 0.7 2 
10 30 0.4 0.8 
11 30 0.55 42 
1 90 0.6 1.9 
2 90 0.6 5.9 
3 90 0.4 33 
4 90 0.6 5 
5 90 0.25 0.6 
6 90 0.3 2.5 
7 90 0.7 4.6 
8 90 0.8 4 
9 90 0.7 1 
10 90 0.38 1.1 
11 90 0.53 * 


* — Missing data. 
Source: Data provided courtesy of Dr. Takanori Yasu. 


Exercises for Use with Large Data Sets Available on the Following Website: 
www.wiley.com/college/daniel 


1. 


Refer to the data for 1050 subjects with cerebral edema (CEREBRAL). Cerebral edema with 
consequent increased intracranial pressure frequently accompanies lesions resulting from head 
injury and other conditions that adversely affect the integrity of the brain. Available treatments for 
cerebral edema vary in effectiveness and undesirable side effects. One such treatment is glycerol, 
administered either orally or intravenously. Of interest to clinicians is the relationship between 
intracranial pressure and glycerol plasma concentration. Suppose you are a statistical consultant 
with a research team investigating the relationship between these two variables. Select a simple 
random sample from the population and perform the analysis that you think would be useful to the 
researchers. Present your findings and conclusions in narrative form and illustrate with graphs 
where appropriate. Compare your results with those of your classmates. 
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2. Refer to the data for 1050 subjects with essential hypertension (HYPERTEN). Suppose you аге а 
statistical consultant to a medical research team interested in essential hypertension. Select a 
simple random sample from the population and perform the analyses that you think would be 
useful to the researchers. Present your findings and conclusions in narrative form and illustrate 
with graphs where appropriate. Compare your results with those of your classmates. Consult with 
your instructor regarding the size of sample you should select. 

3. Refer to the data for 1200 patients with rheumatoid arthritis (CALCIUM). One hundred patients 
received the medicine at each dose level. Suppose you are a medical researchers wishing to gain 
insight into the nature of the relationship between dose level of prednisolone and total body 
calcium. Select a simple random sample of three patients from each dose level group and do the 
following. 

(a) Use the total number of pairs of observations to obtain the least-squares equation describing 
the relationship between dose level (the independent variable) and total body calcium. 

(b) Draw a scatter diagram of the data and plot the equation. 

(c) Compute r and test for significance at the .05 level. Find the p value. 

(d) Compare your results with those of your classmates. 
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MULTIPLE REGRESSION 
AND CORRELATION 


CHAPTER OVERVIEW 


This chapter provides extensions ofthe simple linear regression and bivariate 
correlation models discussed in Chapter 9. The concepts and techniques 
discussed here are useful when the researcher wishes to consider simulta- 
neously the relationships among more than two variables. Although the 
concepts, computations, and interpretations associated with analysis of 
multiple-variable data may seem complex, they are natural extensions of 
material explored in previous chapters. 


TOPICS 


10.1 INTRODUCTION 

10.2 THE MULTIPLE LINEAR REGRESSION MODEL 

10.3 OBTAINING THE MULTIPLE REGRESSION EQUATION 
10.4 EVALUATING THE MULTIPLE REGRESSION EQUATION 
10.5 USING THE MULTIPLE REGRESSION EQUATION 

10.6 THE MULTIPLE CORRELATION MODEL 

10.7 SUMMARY 


LEARNING OUTCOMES 


After studying this chapter, the student will 


1. understand how to include more than one independent variable in a regression 
equation. 


2. be able to obtain a multiple regression model and use it to make predictions. 


be able to evaluate the multiple regression coefficients and the suitability of the 
regression model. 


4. understand how to calculate and interpret multiple, bivariate, and partial 
correlation coefficients. 
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10.1 


INTRODUCTION 


In Chapter 9 we explored the concepts and techniques for analyzing and making use of the 
linear relationship between two variables. We saw that this analysis may lead to a linear 
equation that can be used to predict the value of some dependent variable given the value of 
an associated independent variable. 

Intuition tells us that, in general, we ought to be able to improve our predicting ability 
by including more independent variables in such an equation. For example, a researcher 
may find that intelligence scores of individuals may be predicted from physical factors such 
as birth order, birth weight, and length of gestation along with certain hereditary and 
external environmental factors. Length of stay in a chronic disease hospital may be related 
to the patient's age, marital status, sex, and income, not to mention the obvious factor of 
diagnosis. The response of an experimental animal to some drug may depend on the size of 
the dose and the age and weight of the animal. A nursing supervisor may be interested in 
the strength of the relationship between a nurse's performance on the job, score on the state 
board examination, scholastic record, and score on some achievement or aptitude test. Or a 
hospital administrator studying admissions from various communities served by the 
hospital may be interested in determining what factors seem to be responsible for 
differences in admission rates. 

The concepts and techniques for analyzing the associations among several 
variables are natural extensions of those explored in the previous chapters. The 
computations, as one would expect, are more complex and tedious. However, as is 
pointed out in Chapter 9, this presents no real problem when a computer is available. It is 
not unusual to find researchers investigating the relationships among a dozen or more 
variables. For those who have access to a computer, the decision as to how many 
variables to include in an analysis is based not on the complexity and length of the 
computations but on such considerations as their meaningfulness, the cost of their 
inclusion, and the importance of their contribution. 

In this chapter we follow closely the sequence of the previous chapter. The regression 
model is considered first, followed by a discussion of the correlation model. In considering 
the regression model, the following points are covered: a description of the model, methods 
for obtaining the regression equation, evaluation of the equation, and the uses that may be 
made of the equation. In both models the possible inferential procedures and their 
underlying assumptions are discussed. 


10.2 THE MULTIPLE LINEAR 
REGRESSION MODEL 


In the multiple regression model we assume that a linear relationship exists between some 
variable Y, which we call the dependent variable, and k independent variables, 
X1,X2,...,Xx. The independent variables are sometimes referred to as explanatory 
variables, because of their use in explaining the variation in Y. They are also called 
predictor variables, because of their use in predicting Y. 
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Assumptions The assumptions underlying multiple regression analysis are as 
follows. 


1. The X; are nonrandom (fixed) variables. This assumption distinguishes the multiple 
regression model from the multiple correlation model, which will be presented in 
Section 10.6. This condition indicates that any inferences that are drawn from sample 
data apply only to the set of X values observed and not to some larger collection of X's. 
Under the regression model, correlation analysis is not meaningful. Under the correla- 
tion model to be presented later, the regression techniques that follow may be applied. 


2. For each set of X; values there is a subpopulation of Y values. To construct certain 
confidence intervals and test hypotheses, it must be known, or the researcher must be 
willing to assume, that these subpopulations of Y values are normally distributed. 
Since we will want to demonstrate these inferential procedures, the assumption of 
normality will be made in the examples and exercises in this chapter. 


3. The variances of the subpopulations of Y are all equal. 


4. The Y values are independent. That is, the values of Y selected for one set of X values 
do not depend on the values of Y selected at another set of X values. 


The Model Equation The assumptions for multiple regression analysis may be 
stated in more compact fashion as 


ур= Bo + Bixi + Вох; С Bag + Е (10.2.1) 


where y; is a typical value from one of the subpopulations of Y values; the В; are called the 
regression coefficients; хуу, Xj, . - . , xj are, respectively, particular values of the indepen- 
dent variables X1, X2, .. . Ху; and є; is a random variable with mean 0 and variance o?, the 
common variance of the subpopulations of Y values. To construct confidence intervals for 
and test hypotheses about the regression coefficients, we assume that the e; are normally 
and independently distributed. The statements regarding e; are a consequence of the 
assumptions regarding the distributions of Y values. We will refer to Equation 10.2.1 as the 
multiple linear regression model. 

When Equation 10.2.1 consists of one dependent variable and two independent 
variables, that is, when the model is written 


yj = Bo + Вуху + Boxy + є; (10.2.2) 


a plane in three-dimensional space may be fitted to the data points as illustrated in Figure 
10.2.1. When the model contains more than two independent variables, it is described 
geometrically as a hyperplane. 

In Figure 10.2.1 the observer should visualize some of the points as being located 
above the plane and some as being located below the plane. The deviation of a point from 
the plane is represented by 


єї = yj — Bo з Вуху — Box; (10.2.3) 


In Equation 10.2.2, Во represents the point where the plane cuts the Y-axis; that is, it 
represents the Y-intercept of the plane. $, measures the average change in Y for a unit 
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Y 


Regression plane 


Deviations from the 


X2 
FIGURE 10.2.1 Multiple regression plane and scatter of points. 
change in X; when X» remains unchanged, and $, measures the average change in Y for a 


unit change in X? when X, remains unchanged. For this reason В; and В» are referred to as 
partial regression coefficients. 


10.3 OBTAINING THE MULTIPLE 
REGRESSION EQUATION 


Unbiased estimates of the parameters Ву, Ву,..., В; of the model specified in Equation 
10.2.1 are obtained by the method of least squares. This means that the sum of the squared 
deviations of the observed values of Y from the resulting regression surface is minimized. 
In the three-variable case, as illustrated in Figure 10.2.1, the sum of the squared deviations 
of the observations from the plane are a minimum when Во, Ву, and В, are estimated by the 
method of least squares. In other words, by the method of least squares, sample estimates of 
Во, Ві, ..., Ву are selected in such a way that the quantity 


>=» 0 Bo — Віху — вою — 5 Buy). 


is minimized. This quantity, referred to as the sum of squares of the residuals, may also be 


written as 
Ne = Y (1-5) (10.3.1) 


indicating the fact that the sum of squares of deviations of the observed values of Y from the 
values of Y calculated from the estimated equation is minimized. 
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Estimates of the multiple regression parameters may be obtained by means of 
arithmetic calculations performed on a handheld calculator. This method of obtaining the 
estimates is tedious, time-consuming, subject to errors, and a waste of time when a 
computer is available. Those interested in examining or using the arithmetic approach may 
consult earlier editions of this text or those by Snedecor and Cochran (1) and Steel and 
Torrie (2), who give numerical examples for four variables, and Anderson and Bancroft (3), 
who illustrate the calculations involved when there are five variables. In the following 
example we use SPSS software to illustrate an interesting graphical summary of sample 
data collected on three variables. We then use MINITAB and SAS to illustrate the 
application of multiple regression analysis. 


EXAMPLE 10.3.1 


Researchers Jansen and Keller (A-1) used age and education level to predict the capacity to 
direct attention (CDA) in elderly subjects. CDA refers to neural inhibitory mechanisms that 
focus the mind on what is meaningful while blocking out distractions. The study collected 
information on 71 community-dwelling older women with normal mental status. The CDA 
measurement was calculated from results on standard visual and auditory measures requiring 
the inhibition of competing and distracting stimuli. In this study, CDA scores ranged from 
— 1.65 to 9.61 with higher scores corresponding with better attentional functioning. The 
measurements on CDA, age in years, and education level (years of schooling) for 71 subjects 
are shown in Table 10.3.1. We wish to obtain the sample multiple regression equation. 


TABLE 10.3.1 CDA Scores, Age, and Education Level 
for 71 Subjects Described in Example 10.3.1 


Age Ed-Level CDA Age Ed-Level CDA 
72 20 4.57 79 12 3.17 
68 12 —3.04 87 12 —1.19 
65 13 1.39 71 14 0.99 
85 14 —3.55 81 16 —2.94 
84 13 —2.56 66 16 —2.21 
90 15 —4.66 81 16 —0.75 
79 12 —2.70 80 13 5.07 
74 10 0.30 82 12 —5.86 
69 12 —4.46 65 13 5.00 
87 15 —6.29 73 16 0.63 
84 12 —4.43 85 16 2.62 
79 12 0.18 83 17 1.77 
71 12 —1.37 83 8 —3.79 
76 14 3.26 76 20 1.44 
73 14 —1.12 77 12 —5.77 
86 12 —0.77 83 12 —5.77 
69 17 3.73 79 14 —4.62 
66 11 —5.92 69 12 —2.03 


(Continued) 
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Age Ed-Level CDA Age Ed-Level CDA 
65 16 5.74 66 14 —2.22 
71 14 2.83 75 12 0.80 
80 18 —2.40 77 16 —0.75 
81 11 —0.29 78 12 —4.60 
66 14 4.44 83 20 2.68 
76 17 3.35 85 10 -3.69 
70 12 -3.13 76 18 4.85 
76 12 —2.14 75 14 —0.08 
67 12 9.61 70 16 0.63 
72 20 7.57 79 16 5.92 
68 18 2.21 75 18 3.63 

102 12 —2.30 94 8 —7.07 
67 12 1.73 76 18 6.39 
66 14 6.03 84 18 —0.08 
75 18 —0.02 79 17 1.07 
91 13 —7.65 78 16 5.31 
74 15 4.17 79 12 0.30 
90 15 —0.68 


Source: Data provided courtesy of Debra A. Jansen, Ph.D., R.N. 


Prior to analyzing the data using multiple regression techniques, it is useful to 
construct plots of the relationships among the variables. This is accomplished by making 
separate plots of each pair of variables, (X1, X2), (X1, Y), and (X2, У). A software package 
such as SPSS displays each combination simultaneously in a matrix format as shown in 
Figure 10.3.1. From this figure it is apparent that we should expect a negative relationship 


Ed-Level 


CDA 


Age Ed-Level CDA 
FIGURE 10.3.1 SPSS matrix scatter plot of the data in Table 10.3.1. 
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Dialog box: Session command: 


Stat » Regression » Regression МТВ > Name C4 = "SRESI1' 
Type Y in Response and X7 X2 C5 = ^FITS1' C6 = "^RESII' 
in Predictors. МТВ > Regress Су" 2 `х1’ `х2'; 
Check Residuals. SUBC» SResiduals 'SRES1'; 
Check Standard resids. SUBC» Fits "FITS1'; 
Check OK. SUBC» Constant; 

SUBC> Residuals "RESI1'. 


Output: 


Regression Analysis: Y versus X1, X2 


The regression equation is 
5.49 - 0.184 X1 + 0.611 X2 


Predictor Coef SE Coef T. 
Constant 5.494 4.443 1.24 
-0.18412 0.04851 -3.80 

0.6108 0.1357 4.50 


R-Sq (adj) - 


Source MS F 
Regression : 196.69 20.02 
Residual Error В 9.82 

Total 


Source 
X1 
X2 


Unusual Observations 

Obs X1 Y i SE Fit Residual St Resid 
28 67 9.610 .487 0.707 95123 .99R 
31 102 -2.300 .957 1.268 3.657 .28X 
44 80 5.070 .296 0.425 6.366 .05R 
67 94 -7.070 .927 4129 -0.143 .05X 


R denotes an observation with a large standardized residual. 
X denotes an observation whose X value gives it large influence. 


FIGURE 10.3.2 MINITAB procedure and output for Example 10.3.1. 
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The REG Procedure 


Model: МОРЕТІ 
Dependent Variable: CDA 


Analysis of Variance 


Sum of Mean 
Source Squares Square F Value Pr » F 


Model 393.38832 196.69416 20.02 «.0001 
Error 667.97084 9.82310 
Corrected Total 1061.35915 


Root MSE .13418 R-Square 
Dependent .00676 Adj R-Sq 
Coeff Var 46360 


Parameter Estimates 


Parameter Standard 
Variable Estimate Error 


Intercept 5.49407 4.44297 
AGE -0.18412 0.04851 
EDUC 0.61078 0.13565 


FIGURE 10.3.3 SAS? output for Example 10.3.1. 


between CDA and Age and a positive relationship between CDA and Ed-Level. We shall 
see that this is indeed the case when we use MINITAB to analyze the data. 


Solution: We enter the observations on age, education level, and CDA in c1 through c3 
and name them X1, X2, and Y, respectively. The MINITAB dialog box and 
session command, as well as the output, are shown in Figure 10.3.2. We see 
from the output that the sample multiple regression equation, in the notation 
of Section 10.2, is 


У; = 5.49 — .184х1; + .611x); 


Other output entries will be discussed in the sections that follow. 
The SAS output for Example 10.3.1 is shown in Figure 10.3.3. m 


After the multiple regression equation has been obtained, the next step involves its 
evaluation and interpretation. We cover this facet of the analysis in the next section. 
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EXERCISES 


10.3.1 


10.3.2 


Obtain the regression equation for each of the following data sets. 

Machiel Naeije (A-2) studied the relationship between maximum mouth opening and measurements 
of the lower jaw (mandible). He measured the dependent variable, maximum mouth opening (MMO, 
measured in mm), as well as predictor variables, mandibular length (ML, measured in mm) and angle 
of rotation of the mandible (RA, measured in degrees) of 35 subjects. 


MMO (Y) ML (X) RA (%2) MMO (Y) ML (X) RA (X;) 
52.34 100.85 32.08 50.82 90.65 38.33 
51.90 93.08 39.2] 40.48 92.99 25.93 
52.80 98.43 33.74 59.68 108.97 36.78 
50.29 102.95 34.19 54.35 91.85 42.02 
57.79 108.24 35.13 47.00 104.30 27.20 
49.41 98.34 30.92 47.23 93.16 31.37 
53.28 95.57 37.71 41.19 94.18 27.87 
59.71 98.85 44.71 42.76 89.56 28.69 
53.32 98.32 33.17 51.88 105.85 31.04 
48.53 92.70 31.74 42.77 89.29 32.78 
51.59 88.89 37.07 52.34 92.58 37.82 
58.52 104.06 38.71 50.45 98.64 33.36 
62.93 98.18 43.89 43.18 83.70 31.93 
57.62 91.01 41.06 41.99 88.46 28.32 
65.64 96.98 41.92 39.45 94.93 24.82 
52.85 97.85 35.25 38.91 96.81 23.88 
64.43 96.89 45.11 49.10 93.13 36.17 
57.25 98.35 39.44 


Source: Data provided courtesy of M. Naeije, D.D.S. 


Family caregiving of older adults is more common in Korea than in the United States. Son et al. (A-3) 
studied 100 caregivers of older adults with dementia in Seoul, South Korea. The dependent variable 
was caregiver burden as measured by the Korean Burden Inventory (KBI). Scores ranged from 28 to 
140, with higher scores indicating higher burden. Explanatory variables were indexes that measured 
the following: 


ADL: total activities of daily living (low scores indicate that the elderly perform activities 
independently). 


MEM: memory and behavioral problems (higher scores indicate more problems). 


COG: cognitive impairment (lower scores indicate a greater degree of cognitive impairment). 


The reported data are as follows: 


KBI (Y) ADL (Ху) МЕМ (X2) СОС (X3) KBI (Y) ADL (X,) MEM (X; COG (X3) 


28 39 4 18 88 76 50 5 
68 52 33 9 54 79 44 11 
59 89 17 3 73 48 57 9 
91 57 31 7 87 90 33 6 


(Continued ) 


498 CHAPTER 10 MULTIPLE REGRESSION AND CORRELATION 


KBI(Y) АРІ (Ху) МЕМ (X; СОС (Хз) | KBI(Y) ADL(X) MEM (X; COG (X3) 
70 28 35 19 47 55 11 20 
38 34 3 25 60 83 24 11 
46 42 16 17 65 50 21 25 
57 52 6 26 57 44 31 18 
89 88 41 13 85 79 30 20 
48 90 24 3 28 24 5 22 
74 38 22 13 40 40 20 17 
78 83 41 11 87 35 15 27 
43 30 9 24 80 55 9 21 
76 45 33 14 49 45 28 17 
72 47 36 18 57 46 19 17 
61 90 17 0 32 37 4 21 
63 63 14 16 52 47 29 3 
77 34 35 22 42 28 23 21 
85 76 33 23 49 61 8 7 
31 26 13 18 63 35 31 26 
79 68 34 26 89 68 65 6 
92 85 28 10 67 80 29 10 
76 22 12 16 43 43 8 13 
91 82 57 3 47 53 14 18 
78 80 51 3 70 60 30 16 
103 80 20 18 99 63 22 18 
99 81 20 1 53 28 9 27 
73 30 7 17 78 35 18 14 
88 27 27 27 112 37 33 17 
64 72 9 0 52 82 25 13 
52 46 15 22 68 88 16 0 
71 63 52 13 63 52 15 0 
41 45 26 18 49 30 16 18 
85 77 57 0 42 69 49 12 
52 42 10 19 56 52 17 20 
68 60 34 11 46 59 38 17 
57 33 14 14 72 53 22 21 
84 49 30 15 95 65 56 2 
91 89 64 0 57 90 12 0 
83 72 31 3 88 88 42 6 
73 45 24 19 81 66 12 23 
57 73 13 3 104 60 21 7 
69 58 16 15 88 48 14 13 
81 33 17 21 115 82 41 13 
71 34 13 18 66 88 24 14 
91 90 42 6 92 63 49 5 
48 48 7 23 97 79 34 3 
94 47 17 18 69 71 38 17 
57 32 13 15 112 66 48 13 
49 63 32 15 88 81 66 1 


Source: Data provided courtesy of Gwi-Ryung Son, R.N., Ph.D. 
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10.3.3 In a study of factors thought to be related to patterns of admission to a large general hospital, an 
administrator obtained these data on 10 communities in the hospital's catchment area: 


Index of 
Persons per 1000 Availability of 

Population Admitted Other Health Index of 

During Study Period Services Indigency 
Community (Y) (Хі) (X5) 
1 61.6 6.0 6.3 
2 53.2 4.4 5.5 
3 65.5 9.1 3.6 
4 64.9 8.1 5.8 
5 72.7 9.7 6.8 
6 522 4.8 7.9 
7 50.2 7.6 4.2 
8 44.0 4.4 6.0 
9 53.8 9.1 2.8 
10 53.5 6.7 6.7 
Total 571.6 69.9 55.6 


10.3.4 The administrator of a general hospital obtained the following data on 20 surgery patients during 
a study to determine what factors appear to be related to length of stay: 


Postoperative Preoperative 
Length of Number of Current Length of 
Stay in Days Medical Problems Stay in Days 
(Y) (X) (X5) 


ма 
— 
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10.3.5 


Postoperative Preoperative 
Length of Number of Current Length of 
Stay in Days Medical Problems Stay in Days 
(Y) (X) (X5) 
12 3 2 

8 1 2 

9 2 2 
Total 208 38 43 


A random sample of 25 nurses selected from a state registry yielded the following information on 
each nurse's score on the state board examination and his or her final score in school. Both scores 
relate to the nurse's area of affiliation. Additional information on the score made by each nurse on an 
aptitude test, taken at the time of entering nursing school, was made available to the researcher. The 
complete data are as follows: 


State Board Score Final Score Aptitude Test Score 
(Y) (Ху) (X2) 
440 87 92 
480 87 79 
535 87 99 
460 88 91 
525 88 84 
480 89 71 
510 89 78 
530 89 78 
545 89 71 
600 89 76 
495 90 89 
545 90 90 
575 90 73 
525 91 71 
575 91 81 
600 91 84 
490 92 70 
510 92 85 
575 92 71 
540 93 76 
595 93 90 
525 94 94 
545 94 94 
600 94 93 
625 94 73 


Total 13,425 2263 2053 
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10.3.6 The following data were collected on a simple random sample of 20 patients with hypertension. The 


variables are 


Y = mean arterial blood pressure(mm Hg) 


X; = age(years) 
X; — weight(kg) 


Хз = body surface area(sq m) 

X4 = duration of hypertension( years) 
Xs — basal pulse(beatsthn/min) 

X6 = measure of stress 


Patient Y X, X, X. X4 X; Xs 
1 105 47 85.4 1.75 5.1 63 33 
2 115 49 94.2 2.10 3.8 70 14 
3 116 49 95.3 1.98 8.2 72 10 
4 117 50 94.7 2.01 5.8 73 99 
5 112 51 89.4 1.89 7.0 72 95 
6 121 48 99.5 2.25 9.3 71 10 
7 121 49 99.8 2.25 2.5 69 42 
8 110 47 90.9 1.90 6.2 66 8 
9 110 49 89.2 1.83 7.1 69 62 

10 114 48 92.7 2.07 5.6 64 35 

11 114 47 94.4 2.07 5.3 74 90 

12 115 49 94.1 1.98 5.6 71 21 

13 114 50 91.6 2.05 10.2 68 47 

14 106 45 87.1 1.92 5.6 67 80 

15 125 52 101.3 2.19 10.0 76 98 

16 114 46 94.5 1.98 7.4 69 95 

17 106 46 87.0 1.87 3.6 62 18 

18 113 46 94.5 1.90 4.3 70 12 

19 110 48 90.5 1.88 9.0 71 99 

20 122 56 95.7 2.09 7.0 75 99 


10.4 EVALUATING THE MULTIPLE 


REGRESSION EQUATION 


Before one uses a multiple regression equation to predict and estimate, it is desirable to 
determine first whether it is, in fact, worth using. In our study of simple linear regression we 
have learned that the usefulness of a regression equation may be evaluated by a 
consideration of the sample coefficient of determination and estimated slope. In evaluating 
a multiple regression equation we focus our attention on the coefficient of multiple 
determination and the partial regression coefficients. 


The Coefficient of Multiple Determination 


In Chapter 9 the coeffi- 
cient of determination is discussed in considerable detail. The concept extends logically 
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to the multiple regression case. The total variation present in the Y values may be 
partitioned into two components—the explained variation, which measures the amount 
of the total variation that is explained by the fitted regression surface, and the 
unexplained variation, which is that part of the total variation not explained by fitting 
the regression surface. The measure of variation in each case is a sum of squared 
deviations. The total variation is the sum of squared deviations of each observation of Y 
from the mean of the observations and is designated by >” (>; M or SST. The 
explained variation, designated У; (5, — у) or SST, is the sum of squared deviations 
of the calculated values from the mean of the observed Y values. This sum of squared 
deviations is called the sum of squares due to regression (SSR). The unexplained 
variation, written as У) (у; — 3) , 15 the sum of squared deviations of the original 
observations from the calculated values. This quantity is referred to as the sum of squares 
about regression or the error sum of squares (SSE). We may summarize the relationship 
among the three sums of squares with the following equation: 


Ey- = XG-3-X((-2 
SST = SSR+SSE 


total sum of squares 


(10.4.1) 
explained(regression)sum of squares 


+ unexplained(error)sum of squares 


The coefficient of multiple determination, К 2. is obtained by dividing the 
explained sum of squares by the total sum of squares. That is, 


e. LEG 73 _ SSR 
12..К — — 
і X(-3' 587 


The subscript y.12...k indicates that in the analysis Y 15 treated as the dependent variable 
and the X variables from X, through X; are treated as the independent variables. The value 
of E р indicates what proportion of the total variation in the observed Y values is 
explained by the regression of Yon Х|, X5, ..., Xx. In other words, we may say that R5 ss 
is a measure of the goodness of fit of the regression surface. This quantity is analogous to 
r^, which was computed in Chapter 9. 


(10.4.2) 


EXAMPLE 10.4.1 
Refer to Example 10.3.1. Compute Re s. 


Solution: For our illustrative example we have in Figure 10.3.1 


SST — 1061.36 
SSR — 393.39 
SSE — 667.97 
і 393.39 


2 1061.36 SOR es 
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We say that about 37.1 percent of the total variation in the Y values is 
explained by the fitted regression plane, that is, by the linear relationship 
with age and education level. и 


Testing the Regression Hypothesis To determine whether the overall 
regression is significant (that is, to determine whether R? is significant), we may 
perform a hypothesis test as follows. 


1. 


Data. The research situation and the data generated by the research are examined to 
determine if multiple regression is an appropriate technique for analysis. 
Assumptions. We assume that the multiple regression model and its underlying 
assumptions as presented in Section 10.2 are applicable. 


Hypotheses. In general, the null hypothesis is Но: B; = 6, = В =... = В = 0 
and the alternative is Ha: not all В, = 0. In words, the null hypothesis states that 
all the independent variables are of no value in explaining the variation in the 
Y values. 


Test statistic. The appropriate test statistic is V.R., which is computed as part of 
an analysis of variance. The general ANOVA table is shown as Table 10.4.1. In 
Table 10.4.1, MSR stands for mean square due to regression and MSE stands for 
mean square about regression or, as it is sometimes called, the error mean 
square. 


Distribution of test statistic. When Но is true and the assumptions are met, V.R. is 
distributed as F with k and n — k — 1 degrees of freedom. 


Decision rule. Reject Ho if the computed value of V.R. is equal to or greater than the 
critical value of F. 


Calculation of test statistic. See Table 10.4.1. 

Statistical decision. Reject or fail to reject Но in accordance with the decision rule. 
Conclusion. If we reject Но we conclude that, in the population from which the 
sample was drawn, the dependent variable is linearly related to the independent 
variables as a group. If we fail to reject Ho, we conclude that, in the population from 
which our sample was drawn, there may be no linear relationship between the 
dependent variable and the independent variables as a group. 


10. p value. We obtain the p value from the table of the F distribution. 


We illustrate the hypothesis testing procedure by means of the following example. 


TABLE 10.4.1 ANOVA Table for Multiple Regression 


Source SS d.f. MS V.R. 
Due to regression SSR k MSR = SSR/k MSR/MSE 
About regression SSE n-k-1 MSE = 55Е/(п-К- 1) 

Total SST n-1 
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EXAMPLE 10.4.2 


We wish to test the null hypothesis of no linear relationship among the three variables 
discussed in Example 10.3.1: CDA score, age, and education level. 


Solution: 


1. Data. See the description of the data given in Example 10.3.1. 


2. Assumptions. We assume that the assumptions discussed in Section 
10.2 are met. 


3. Hypotheses. 


Ho: = В, = В =0 
На: = not all B; = 0 


4. Test statistic. The test statistic is V.R. 


5. Distribution of test statistic. If Но is true and the assumptions are met, 
the test statistic is distributed as F with 2 numerator and 68 denominator 
degrees of freedom. 


6. Decision rule. Let us use a significance level of а = .01. The decision 
rule, then, is reject Ho if the computed value of V.R. is equal to or greater 
than 4.95 (obtained by interpolation). 


7. Calculation of test statistic. The ANOVA for the example is shown in 
Figure 10.3.1, where we see that the computed value of V.R. is 20.02. 


8. Statistical decision. Since 20.02 is greater than 4.95, we reject Ho. 


9. Conclusion. We conclude that, in the population from which the sample 
came, there is a linear relationship among the three variables. 


10. p value. Since 20.02 is greater than 5.76, the p value for the test is less 
than .005. и 


Inferences Regarding Individual f's Frequently, we wish to evaluate the 
strength of the linear relationship between Y and the independent variables individually. 
That is, we may want to test the null hypothesis that В; = 0 against the alternative 
В; 4 0(1=1,2,...,k). The validity of this procedure rests on the assumptions stated 
earlier: that for each combination of X; values there is a normally distributed subpopulation 


of Y values with variance o?. 


Hypothesis Tests for the 9; То test the null hypothesis that В; is equal to some 
particular value, say, Ву, the following f statistic may be computed: 
po testo (10.4.3) 
5% 

where the degrees of freedom are equal to n — К — 1, and 55 is the standard deviation of 
the Bj. 

The standard deviations of the р; are given as part of the output from most computer 
software packages that do regression analysis. 
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EXAMPLE 10.4.3 


Let us refer to Example 10.3.1 and test the null hypothesis that age (years) is irrelevant in 
predicting the capacity to direct attention (CDA). 


Solution: 


10. 


. Data. See Example 10.3.1. 
. Assumptions. See Section 10.2. 


. Hypotheses. 
Ho: By =0 
На: Bi A 0 
Leto = .05 
. Test statistic. See Equation 10.4.3. 


. Distribution of test statistic. When Но is true and the assumptions are 


met, the test statistic is distributed as Student's г with 68 degrees of 
freedom. 


. Decision rule. Reject Но if the computed 1 is either greater than or 


equal to 1.9957 (obtained by interpolation) or less than or equal to 
—1.9957. 


. Calculation of test statistic. By Equation 10.4.3 and data from Figure 


10.3.2 we compute 


. Statistical decision. The null hypothesis is rejected since the computed 


value of t, —3.80, is less than —1.9957. 


. Conclusion. We conclude, then, that there is a linear relationship 


between age and CDA in the presence of education level. 


p value. For this test, p « 2(.005) — .01 because —3.80 « —2.6505 
(obtained by interpolation). As shown in Figure 10.3.2, the p-value is 
<.001 for this test. 


Now, let us perform a similar test for the second partial regression coefficient, f»: 


Но: В, =0 

На By #0 

a = .05 
№—0  .6108 


= =, 
> 


[= 
ЗВ, 
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In this case also the null hypothesis is rejected, since 4.50 is greater than 1.9957. We 
conclude that there is a linear relationship between education level and CDA in the 
presence age, and that education level, used in this manner, is a useful variable for 
predicting CDA. [For this test, p < 2(.005) = .01. 


Confidence Intervals for the 8; When the researcher has been led to 
conclude that a partial regression coefficient is not O, he or she may be interested in 
obtaining a confidence interval for this 6;. Confidence intervals for the В; may be 
constructed in the usual way by using a value from the 7 distribution for the reliability 
factor and standard errors given above. 

A 100(1 — о) percent confidence interval for В; is given by 


B; = [1-(0/2),n-k-184 


i 


For our illustrative example we may compute the following 95 percent confidence 
intervals for В, and В». 
The 95 percent confidence interval for f, is 


—.18412 + 1.9957(.04851) 
—.18412 + .0968 
(—.28092, — .08732) 


The 95 percent confidence interval for В» is 


.6108 + (1.9957)(.1357) 
.6108 + .2708 
(.3400, 8816) 


We may give these intervals the usual probabilistic and practical interpretations. We are 
95 percent confident, for example, that В, is contained in the interval from .3400 to .8816 
since, in repeated sampling, 95 percent of the intervals that may be constructed in this 
manner will include the true parameter. 


Some Precautions One should be aware of the problems involved in carrying out 
multiple hypothesis tests and constructing multiple confidence intervals from the same 
sample data. The effect on o of performing multiple hypothesis tests from the same data is 
discussed in Section 8.2. A similar problem arises when one wishes to construct confidence 
intervals for two or more partial regression coefficients. The intervals will not be 
independent, so that the tabulated confidence coefficient does not, in general, apply. In 
other words, all such intervals would not be 100(1 — о) percent confidence intervals. 

In order to maintain approximate 100(1 - o) confidence intervals for partial 
regression coefficients, adjustments must be made to the calculation of errors in the 
previous equations. These adjustments are sometimes called family-wise error rates, and 
can be found in many computer software packages. The topic is discussed in detail by 
Kutner, et al. (4). 
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Another problem sometimes encountered in the application of multiple regression is 
an apparent incompatibility in the results of the various tests of significance that one may 
perform. In a given problem for a given level of significance, one or the other of the 
following situations may be observed. 

1. R? and all B; significant 
R? and some but not all Ё, significant 
Е? significant but none of the B; significant 
All B; significant but not R? 


Some B; significant, but not all nor R 


Aw RWS 


Neither R? nor any B; significant 


Notice that situation 1 exists in our illustrative example, where we have a significant 
R? and two significant regression coefficients. This situation does not occur in all cases. In 
fact, situation 2 is very common, especially when a large number of independent variables 
have been included in the regression equation. 


EXERCISES 


10.4.1 


10.4.2 
10.4.3 
10.4.4 
10.4.5 
10.4.6 


Refer to Exercise 10.3.1. (a) Calculate the coefficient of multiple determination; (b) perform an 
analysis of variance; (c) test the significance of each Bi > 0). Let а = .05 for all tests of 
significance and determine the p value for all tests; (d) construct a 95 percent confidence interval 
for each significant sample slope. 


Refer to Exercise 10.3.2. Do the analysis suggested in Exercise 10.4.1. 
Refer to Exercise 10.3.3. Do the analysis suggested in Exercise 10.4.1. 
Refer to Exercise 10.3.4. Do the analysis suggested in Exercise 10.4.1. 
Refer to Exercise 10.3.5. Do the analysis suggested in Exercise 10.4.1. 


Refer to Exercise 10.3.6. Do the analysis suggested in Exercise 10.4.1. 


10.5 USING THE MULTIPLE 
REGRESSION EQUATION 


As we learned in the previous chapter, a regression equation may be used to obtain a 
computed value of Y, y, when a particular value of X is given. Similarly, we may use our 
multiple regression equation to obtain a y value when we are given particular values of the 
two or more X variables present in the equation. 

Just as was the case in simple linear regression, we may, in multiple regression, 
interpret a y value in one of two ways. First we may interpret Ў as an estimate of the mean 
of the subpopulation of Y values assumed to exist for particular combinations of X; 
values. Under this interpretation У is called an estimate, and when it is used for this 
purpose, the equation is thought of as an estimating equation. The second interpretation 
of у is that it is the value Y is most likely to assume for given values of the X;. In this case У 
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is called the predicted value of Y, and the equation is called a prediction equation. In both 
cases, intervals may be constructed about the У value when the normality assumption of 
Section 10.2 holds true. When $ is interpreted as an estimate of a population mean, the 
interval is called a confidence interval, and when y is interpreted as a predicted value of 
Y, the interval is called a prediction interval. Now let us see how each of these intervals is 
constructed. 


The Confidence Interval for the Mean of a Subpopulation of 
Y Values Given Particular Values of the X; We have seen that a 
100(1 — о) percent confidence interval for a parameter may be constructed by the general 
procedure of adding to and subtracting from the estimator a quantity equal to the reliability 
factor corresponding to 1 — œ multiplied by the standard error of the estimator. We have 
also seen that in multiple regression the estimator is 


$; = Êo + Bioy + Boxy + ++ Bou; (10.5.1) 


If we designate the standard error of this estimator Бу зз, the 100(1 — о) percent confidence 
interval for the mean of Y, given specified X; is as follows: 


Y E fü a]2)n-k-155; (10.5.2) 


The Prediction Interval for a Particular Value of Y Given 
Particular Values of the X; When we interpret as the value Y is most likely 
to assume when particular values of the X; are observed, we may construct a prediction 
interval in the same way in which the confidence interval was constructed. The only 
difference in the two is the standard error. The standard error of the prediction is slightly 
larger than the standard error of the estimate, which causes the prediction interval to be 
wider than the confidence interval. 

If we designate the standard error of the prediction by 5; „ the 100(1 — о) percent 
prediction interval is 


Ў E f-aj2)n-k-155j (10.5.3) 


The calculations of s;, and s; in the multiple regression case are complicated and will not 
be covered in this text. The reader who wishes to see how these statistics are calculated may 
consult the book by Anderson and Bancroft (3), other references listed at the end of this 
chapter and Chapter 9, and previous editions of this text. The following example illustrates 
how MINITAB may be used to obtain confidence intervals for the mean of Yand prediction 
intervals for a particular value of Y. 


EXAMPLE 10.5.1 


We refer to Example 10.3.1. First, we wish to construct a 95 percent confidence interval 
for the mean CDA score (Y) in a population of 68-year-old subjects (X1) who completed 
12 years of education (X5). Second, suppose we have a subject who is 68 years of age 
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and has an education level of 12 years. What do we predict to be this subjects CDA 


score? 


Solution: 


EXERCISES 


The point estimate of the mean CDA score is 
у = 5.494 — .18412(68) + .6108(12) = .3034 


The point prediction, which is the same as the point estimate obtained 
previously, also is 


$ = 5.494 — .18412(68) + .6108(12) = 3034 


To obtain the confidence interval and the prediction interval for the 
parameters for which we have just computed a point estimate and a point 
prediction, we use MINITAB as follows. After entering the information for a 
regression analysis of our data as shown in Figure 10.3.2, we click on Options 
in the dialog box. In the box labeled “Prediction intervals for new obser- 
vations," we type 68 and 12 and click OK twice. In addition to the regression 
analysis, we obtain the following output: 


New Obs Fit SE Fit 95.0% CI 95.0% PI 
1 0.303 0.672 (-1.038, 1.644) (-6.093, 6.699) 


We interpret these intervals in the usual ways. We look first at the 
confidence interval. We are 95 percent confident that the interval from —1.038 
to 1.644 includes the mean of the subpopulation of Y values for the specified 
combination of X; values, since this parameter would be included in about 95 
percent of the intervals that can be constructed in the manner shown. 

Now consider the subject who is 68 years old and has 12 years of 
education. We are 95 percent confident that this subject would have a CDA 
score somewhere between —6.093 and 6.699. The fact that the P.I. is wider 
than the C.I. should not be surprising. After all, it is easier to estimate the 
mean response than it is estimate an individual observation. E 


For each of the following exercises compute the y value and construct (a) 95 percent 
confidence and (b) 95 percent prediction intervals for the specified values of Xj. 


10.5.1 Refer to Exercise 10.3.1 and let xj; = 95 and хо; = 35. 


10.5.2 Refer to Exercise 10.3.2 and let хі; = 50, x2; = 20, and хз; = 22. 


10.5.3 Refer to Exercise 10.3.3 and let xj; = 5 and хо; = 6. 


10.5.4 Refer to Exercise 10.3.4 and let xj; = 1 and хо; = 2. 
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10.5.5 Refer to Exercise 10.3.5 and let xj; = 90 and хо; = 80. 


10.5.6 Refer to Exercise 10.3.6 and let ху = 50, хоу = 95.0, хз = 2.00, x4; = 6.00, x5; = 75, and 
Xej = 70. 


10.6 THE MULTIPLE CORRELATION MODEL 


We pointed out in the preceding chapter that while regression analysis is concerned with 
the form of the relationship between variables, the objective of correlation analysis is to 
gain insight into the strength of the relationship. This is also true in the multivariable case, 
and in this section we investigate methods for measuring the strength of the relationship 
among several variables. First, however, let us define the model and assumptions on which 
our analysis rests. 


The Model Equation We may write the correlation model as 
yj = Bo + Pixy + Во + --- + Boxy + 6j (10.6.1) 


where y; is a typical value from the population of values of the variable Y, the 8° are the 
regression coefficients defined in Section 10.2, and the х; are particular (known) values of 
the random variables X;. This model is similar to the multiple regression model, but there is 
one important distinction. In the multiple regression model, given in Equation 10.2.1, the X; 
are nonrandom variables, but in the multiple correlation model the X; are random variables. 
In other words, in the correlation model there is a joint distribution of Y and the X; that we 
call a multivariate distribution. Under this model, the variables are no longer thought of as 
being dependent or independent, since logically they are interchangeable and either of the 
X; may play the role of Y. 

Typically, random samples of units of association are drawn from a population of 
interest, and measurements of Y and the X; are made. 

A least-squares plane or hyperplane is fitted to the sample data by methods described 
in Section 10.3, and the same uses may be made of the resulting equation. Inferences may 
be made about the population from which the sample was drawn if it can be assumed that 
the underlying distribution is normal, that is, if it can be assumed that the joint distribution 
of Yand X; is a multivariate normal distribution. In addition, sample measures of the degree 
of the relationship among the variables may be computed and, under the assumption that 
sampling is from a multivariate normal distribution, the corresponding parameters may be 
estimated by means of confidence intervals, and hypothesis tests may be carried out. 
Specifically, we may compute an estimate of the multiple correlation coefficient that 
measures the dependence between Y and the X;. This is a straightforward extension of the 
concept of correlation between two variables that we discuss in Chapter 9. We may also 
compute partial correlation coefficients that measure the intensity of the relationship 
between any two variables when the influence of all other variables has been removed. 


The Multiple Correlation Coefficient As a first step in analyzing the 
relationships among the variables, we look at the multiple correlation coefficient. 
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The multiple correlation coefficient is the square root of the coefficient of multiple 
determination and, consequently, the sample value may be computed by taking the square 
root of Equation 10.4.2. That is, 


Було к= YR ү = = (10.6.2) 


To illustrate the concepts and techniques of multiple correlation analysis, let us 
consider an example. 


EXAMPLE 10.6.1 


Wang et al. (A-4), using cadaveric human femurs from subjects ages 16 to 19 years, 
investigated toughness properties of the bone and measures of the collagen network within 
the bone. Two variables measuring the collagen network are porosity (P, expressed as a 
percent) and a measure of collagen network tensile strength (S). The measure of toughness 
(W, Newtons), is the force required for bone fracture. The 29 cadaveric femurs used in the 
study were free from bone-related pathologies. We wish to analyze the nature and strength 
of the relationship among the three variables. The measurements are shown in the 
following table. 


TABLE 10.6.1 Bone Toughness and 
Collagen Network Properties for 
29 Femurs 


үү Р S 
193.6 6.24 30.1 
137.5 8.03 22.2 
145.4 11.62 25.7 
117.0 7.68 28.9 
105.4 10.72 27.3 
99.9 9.28 33.4 
74.0 6.23 26.4 
74.4 8.67 17.2 
112.8 6.91 15.9 
125.4 7.51 12.2 
126.5 10.01 30.0 
115.9 8.70 24.0 
98.8 5.87 22.6 
94.3 7.96 18.2 
99.9 12.27 11.5 
83.3 7.33 23.9 
72.8 11.17 11.2 
83.5 6.03 15.6 
59.0 7.90 10.6 


(Continued) 
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МУ Р 5 

87.2 8.27 24.7 

84.4 11.05 25.6 

78.1 7.61 18.4 

51.9 6.21 13.5 

57.1 7.24 12.2 

54.7 8.11 14.8 

78.6 10.05 8.9 

53.7 8.79 14.9 

96.0 10.40 10.3 Source: Data provided courtesy 
89.0 11.72 15.4 of Xiaodu Wang, Ph.D. 


Solution: We use MINITAB to perform the analysis of our data. Readers interested in 
the derivation of the underlying formulas and the arithmetic procedures 
involved may consult the texts listed at the end of this chapter and Chapter 9, 
as well as previous editions of this text. If a least-squares prediction equation 
and multiple correlation coefficient are desired as part of the analysis, we 
may obtain them by using the previously described MINITAB multiple 
regression procedure. When we do this with the sample values of Y, X;, and 
X», stored in Columns 1 through 3, respectively, we obtain the output shown 
in Figure 10.6.1. 

The least-squares equation, then, is 


У; = 35.61 + 1.451х1; + 2.3960x5; 


The regression equation is 
35.6 + 1.45 X1 + 2.40 X2 


Predictor Coef SE Coef T 
Constant 35.61 29.13 1.22 
1.451 2.763 0.53 

2.3960 0.7301 3.28 


27.42 х R-Sq (adj) 


Analysis of Variance 


Source DF SS MS 

Regression 2 8151.1 4075.6 5.42 0.011 
Residual Error 26 295535 POD tL 

Total 28 27704.6 


FIGURE 10.6.1 Output from MINITAB multiple regression procedure for the data in 
Table 10.6.1. 
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This equation may be used for estimation and prediction purposes and may 
be evaluated by the methods discussed in Section 10.4. 

As we see in Figure 10.6.1, the multiple regression output also gives us 
the coefficient of multiple determination, which, in our present example, is 


2 
Ri = 294 


The multiple correlation coefficient, therefore, is 


Куло = V.294 = .542 


Interpretation of К, 12 


We interpret Ry |; as a measure of the correlation among the variables force required to 
fracture, porosity, and collagen network strength in the sample of 29 femur bones from 
subjects ages 16 to 19. If our data constitute a random sample from the population of such 
persons, we may use К, ¡2 as an estimate of p, |, the true population multiple correlation 
coefficient. We may also interpret К, 1» as the simple correlation coefficient between y; and 
5, the observed and calculated values, respectively, of the “dependent” variable. Perfect 
correspondence between the observed and calculated values of Y will result in a correlation 
coefficient of 1, while a complete lack of a linear relationship between observed and 
calculated values yields a correlation coefficient of 0. The multiple correlation coefficient 
is always given a positive sign. 
We may test the null hypothesis that р, о = 0 by computing 


(10.6.3) 


The numerical value obtained from Equation 10.6.3 is compared with the tabulated value 
of F with k and n — k — 1 degrees of freedom. The reader will recall that this is identical to 
the test of Ho: B; = PB, = ··· = В; = 0 described in Section 10.4. 

For our present example let us test the null hypothesis that o, ,; = 0 against the 
alternative that р, 12 4 0. We compute 


294 29—2—1 


Е = : 
1 — .294 2 


= 5.41 


Since 5.41 is greater than 4.27, p < .025, so that we may reject the null hypothesis at the 
.025 levelof significance and conclude that the force required for fracture is correlated with 
porosity and the measure of collagen network strength in the sampled population. 

The computed value of F for testing Но that the population multiple correlation 
coefficient is equal to zero is given in the analysis of variance table in Figure 10.6.1 and is 
5.42. The two computed values of F differ as a result of differences in rounding in the 
intermediate calculations. и 


Partial Correlation The researcher may wish to have a measure of the strength 
of the linear relationship between two variables when the effect of the remaining variables 
has been removed. Such a measure is provided by the partial correlation coefficient. 
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For example, the partial sample correlation coefficient ғу уә is a measure of the correlation 
between Y and X, after controlling for the effect of X». 

The partial correlation coefficients may be computed from the simple correlation 
coefficients. The simple correlation coefficients measure the correlation between two 
variables when no effort has been made to control other variables. In other words, they are 
the coefficients for any pair of variables that would be obtained by the methods of simple 
correlation discussed in Chapter 9. 

Suppose we have three variables, Y, X,, and X2. The sample partial correlation 
coefficient measuring the correlation between Y and X, after controlling for X5, for 
example, is written гу1.2. In the subscript, the symbol to the right of the decimal point 
indicates the variable whose effect is being controlled, while the two symbols to the left of 
the decimal point indicate which variables are being correlated. For the three-variable case, 
there are two other sample partial correlation coefficients that we may compute. They are 
Гу2.1 and г.у. 


The Coefficient of Partial Determination Тһе square of the partial 
correlation coefficient is called the coefficient of partial determination. It provides useful 
information about the interrelationships among variables. Consider ry; 2, for example. Its 
square, Is tells us what proportion of the remaining variability in Y is explained by X, 
after X5 has explained as much of the total variability in Y as it can. 


Calculating the Partial Correlation Coefficients For three variables 
the following simple correlation coefficients may be calculated: 


гут, the simple correlation between Y and X, 
r,2, the simple correlation between Y and X; 


712, the simple correlation between X, and X5 


The MINITAB correlation procedure may be used to compute these simple correla- 
tion coefficients as shown in Figure 10.6.2. As noted earlier, the sample observations are 
stored in Columns 1 through 3. From the output in Figure 10.6.2 we see that 
712 = —.08, ғу = .043, and ry = .535. 

The sample partial correlation coefficients that may be computed from the simple 
correlation coefficients in the three-variable case are: 


1. The partial correlation between Y and X, after controlling for the effect of Х»: 


rua = (rà — nari) / Af (1-8) (1-5) (10.6.4) 
2. The partial correlation between Y and X» after controlling for the effect of X;: 


Гугл = (ro = го) (1-5) 01775) (10.6.5) 


3. The partial correlation between X, and X» after controlling for the effect of Y: 


roy = (ria — гууз) /\/ 17) (17) (10.6.6) 
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Dialog box: Session Command: 


Stat » Basic Statistics » Correlation MTB» CORRELATION C1-C3 


Type C1-C3 in Variables. Click OK. 


Output: 


X1 


Y 
0.043 
0.823 


0.535 -0.080 
0.003 0.679 


Cell Contents: Pearson correlation 


P-Value 


FIGURE 10.6.2 MINITAB procedure for calculating the simple correlation coefficients for the 
data in Table 10.6.1. 


EXAMPLE 10.6.2 


To illustrate the calculation of sample partial correlation coefficients, let us refer to 
Example 10.6.1, and calculate the partial correlation coefficients among the variables force 
to fracture (Y), porosity (Xj), and collagen network strength (X2). 


Solution: 


Instead of computing the partial correlation coefficients from the simple 
correlation coefficients by Equations 10.6.4 through 10.6.6, we use MINITAB 
to obtain them. 

The MINITAB procedure for computing partial correlation coefficients 
is based on the fact that a given partial correlation coefficient is itself the 
simple correlation between two sets of residuals. A set of residuals is 
obtained as follows. Suppose we have measurements on two variables, X 
(independent) and Y (dependent). We obtain the least-squares prediction 
equation, ў = Bo + В. For each value of X we compute a residual, which is 
equal to (y; - 5;), the difference between the observed value of Y and the 
predicted value of Y associated with the X. 

Now, suppose we have three variables, X;, Xo, and Y. We want to 
compute the partial correlation coefficient between X; and Y while holding 
X» constant. We regress X; on X» and compute the residuals, which we may call 
residual set A. We regress Y on X» and compute the residuals, which we may 
call residual set B. The simple correlation coefficient measuring the strength of 
the relationship between residual set A and residual set B is the partial 
correlation coefficient between X, and Y after controlling for the effect of X5. 
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When using MINITAB we store each set of residuals in a different 
column for future use in calculating the simple correlation coefficients 
between them. 

We use session commands rather than a dialog box to calculate the 
partial correlation coefficients when we use MINITAB. With the observa- 
tions on Хі, X», and Y stored in Columns | through 3, respectively, the 
procedure for the data of Table 10.6.1 is shown in Figure 10.6.3. The output 
shows that ry}. = .102, 712, = —.122, and rj? = .541. 

Partial correlations can be calculated directly using SPSS software as 
seen in Figure 10.6.5. This software displays, in a succinct table, both the 
partial correlation coefficient and the p value associated with each partial 
correlation. Е 


Testing Hypotheses About Partial Correlation Coefficients We 
may test the null hypothesis that any one of the population partial correlation coefficients is 
0 by means of the f test. For example, to test Но: 0,1». = 0, we compute 


n—k-1 


2 


(10.6.7) 
De, Гу1.2...К 


t = y1.2...k 


which is distributed as Student's t with n — k — 1 degrees of freedom. 
Let us illustrate the procedure for our current example by testing Но: 0,12 = 0 
against the alternative, Ha: ру о 7- 0. The computed 1 is 


t= 102 абс ты 30 523 
1 — (.102) 


Since the computed ¢ of .523 is smaller than the tabulated 1 of 2.0555 for 26 degrees of 
freedom and o = .05 (two-sided test), we fail to reject Но at the .05 level of significance 
and conclude that there may be no correlation between force required for fracture and 
porosity after controlling for the effect of collagen network strength. Significance tests for 
the other two partial correlation coefficients will be left as an exercise for the reader. Note 
that p values for these tests are calculated by MINITAB as shown in Figure 10.6.3. 

The SPSS statistical software package for the PC provides a convenient procedure for 
obtaining partial correlation coefficients. To use this feature choose "Analyze" from the 
menu bar, then “Correlate,” and, finally, “Partial.” Following this sequence of choices the 
Partial Correlations dialog box appears on the screen. In the box labeled “Variables:,” enter 
the names of the variables for which partial correlations are desired. In the box labeled 
"Controlling for:” enter the names of the variable(s) for which you wish to control. Select 
either a two-tailed or one-tailed level of significance. Unless the option is deselected, actual 
significance levels will be displayed. For Example 10.6.2, Figure 10.6.4 shows the SPSS 
computed partial correlation coefficients between the other two variables when controlling, 
successively, for X; (porosity), X» (collagen network strength), and Y (force required for 
fracture). 
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regress Cl 1 
residuals C4. 


regress C3 1 
residuals C5. 


regress Cl 1 
residuals C6. 


regress C2 1 
residuals C7. 


regress C2 1 
residuals C8. 


regress C3 1 
residuals C9. 


corr -C4 “C5 
Correlations: C4, C5 


Pearson correlation C4 and C5 
P-Value = 0.597 


MTB > corr C6 C7 
Correlations: C6, C7 


Pearson correlation C6 and C7 
P-Value = 0.527 


MTB > corr C8 C9 


Correlations: C8, C9 


Pearson correlation of C8 and C9 
P-Value = 0.002 


FIGURE 10.6.3 MINITAB procedure for computing partial correlation coefficients from the 
data of Table 10.6.1. 
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Controlling for: 


(Coefficient / (D.F.) / 2-tailed Significance) 
"." is printed if a coefficient cannot be computed 


FIGURE 10.6.4 Partial coefficients obtained with SPSS for Windows, Example 10.6.2. 


10.6 THE MULTIPLE CORRELATION MODEL 


Correlations 


Force to 
Control Variables Fracture (Y) | Porosity (X1) 
Tensile Strength (X2) Force to Fracture (Y) Correlation 1.000 .102 
Significance (2-tailed) Е .604 
df 0 26 
Porosity (X1) Correlation .102 1.000 
Significance (2-tailed) .604 р 
df 26 0 
(a) 
Correlations 
Porosity Tensile 
Control Variables (X1) Strength (X2) 
Force to Fracture (Y) Porocity (X1) Correlation 1.000 -.122 
Significance (2-tailed) ; .535 
df 0 26 
Tensile Strength (X2) Correlation -.122 1.000 
Significance (2-tailed) .535 : 
ағ 26 0 
(b) 
Correlations 
Tensile Force to 


Control Variables 


Strength (X2) 


Fracture (Y) 


Porosity (X1) 


Tensile Strength (X2) Correlation 1.000 .541 
Significance (2-tailed) : .003 
df 0 26 
Force to Fracture (Y) Correlation .541 1.000 
Significance (2-tailed) .003 я 
ағ 26 0 


(с) 


FIGURE 10.6.5 Partial correlation coefficients for the data in Example 10.6.1. (а) Гул.2, (b) газу, 


and (с) ry24. 


variables increases. 


Although our illustration of correlation analysis is limited to the three-variable 
case, the concepts and techniques extend logically to the case of four or more variables. 
The number and complexity of the calculations increase rapidly as the number of 
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EXERCISES 


10.6.1 The objective of a study by Anton et al. (A-5) was to investigate the correlation structure of multiple 
measures of HIV burden in blood and tissue samples. They measured HIV burden four ways. Two 
measurements were derived from blood samples, and two measurements were made on rectal tissue. 
The two blood measures were based on HIV DNA assays and a second co-culture assay that was a 
modification of the first measure. The third and fourth measurements were quantitations of HIV-1 
DNA and RNA from rectal biopsy tissue. The table below gives data on HIV levels from these 
measurements for 34 subjects. 


HIV DNA HIV Co-Culture HIV DNA Rectal HIV RNA Rectal 
Blood (Y) Blood (X4) Tissue (X;) Tissue (X3) 
115 .38 899 56 
86 1.65 167 158 
19 .16 73 152 
6 .08 146 35 
23 .02 82 60 
147 1.98 2483 1993 
27 .15 404 30 
140 25 2438 72 
345 .55 780 12 
92 .22 517 5 
85 09 346 5 
24 17 82 12 
109 41 1285 5 
5 02 380 5 
95 84 628 32; 
46 02 451 5 
25 .64 159 5 
187 20 1335 121 
5 04 30 5 
47 02 13 30 
118 24 5 5 
112 72; 625 83 
79 45 719 70 
52 123 309 167 
22 .06 27 29 
7 37 199 5 
13 .13 510 42 
80 24 271 15 
86 96 273 45 
26 .29 534 71 
53 25 473 264 
185 28 2932 108 
30 .19 658 33 
9 03 103 5 
76 21 2339 5 


(Continued ) 
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HIV DNA HIV Co-Culture HIV DNA Rectal HIV RNA Rectal 
Blood (Y) Blood (X4) Tissue (X;) Tissue (X3) 

51 .09 31 36 

73 .06 158 5 

47 .08 773 5 

48 12 545 67 

16 .03 5 5 


Source: Data provided courtesy of Peter A. Anton, M.D. 


(a) Compute the simple correlation coefficients between all possible pairs of variables. 

(b) Compute the multiple correlation coefficient among the four variables. Test the overall 
correlation for significance. 

(c) Calculate the partial correlations between HIV DNA blood and each one of the other 
variables while controlling for the other two. (These are called second-order partial correlation 
coefficients.) 

(d) Calculate the partial correlation between HIV co-culture blood and HIV DNA, controlling for the 
other two variables. 

(e) Calculate the partial correlation between HIV co-culture blood and HIV RNA, controlling for the 
other two variables. 


(f) Calculate the partial correlations between HIV DNA and HIV RNA, controlling for the other two 
variables. 


The following data were obtained on 12 males between the ages of 12 and 18 years (all measurements 
are in centimeters): 


Height Radius Length Femur Length 
(Y) (X) (X5) 
149.0 21.00 42.50 
152.0 21.79 43.70 
155.7 22.40 44.75 
159.0 23.00 46.00 
163.3 23.70 47.00 
166.0 24.30 47.90 
169.0 24.92 48.95 
172.0 25.50 49.90 
174.5 25.80 50.30 
176.1 26.01 50.90 
176.5 26.15 50.85 
179.0 26.30 51.10 
Total 1992.1 290.87 573.85 


(a) Find the sample multiple correlation coefficient and test the null hypothesis that o, ;; = 0. 


(b) Find each of the partial correlation coefficients and test each for significance. Let a = .05 for all 
tests. 


(c) Determine the p value for each test. 


(d) State your conclusions. 
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10.6.3 The following data were collected on 15 obese girls: 


Weight in Lean Body Mean Daily 
Kilograms Weight Caloric Intake 
(Y) (X1) (X2) 
79.2 54.3 2670 
64.0 44.3 820 
67.0 47.8 1210 
78.4 53.9 2678 
66.0 47.5 1205 
63.0 43.0 815 
65.9 47.1 1200 
63.1 44.0 1180 
73.2 44.1 1850 
66.5 48.3 1260 
61.9 43.5 1170 
72.5 43.3 1852 
101.1 66.4 1790 
66.2 47.5 1250 
99.9 66.1 1789 


Total 1087.9 741.1 22739 


(a) Find the multiple correlation coefficient and test it for significance. 


(b) Find each of the partial correlation coefficients and test each for significance. Let a = .05 for all 
tests. 


(c) Determine the p value for each test. 
(d) State your conclusions. 
10.6.4 А research project was conducted to study the relationships among intelligence, aphasia, and apraxia. 


The subjects were patients with focal left hemisphere damage. Scores on the following variables were 
obtained through the application of standard tests. 


Y — intelligence 
X, = ideomotor apraxia 
X» = constructive apraxia 
Хз = lesion volume(pixels) 
X4 — severity of aphasia 
The results are shown in the following table. Find the multiple correlation coefficient and test 
for significance. Let о = .05 and find the p value. 


Subject Y Хү X5 Хз X4 
1 66 7.6 7.4 2296.87 2 
2 78 13.2 11.9 2975.82 8 
3 79 13.0 12.4 2839.38 11 
4 84 14.2 13.3 3136.58 15 


(Continued ) 
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Subject Y X X; ра X4 
5 77 11.4 11.2 2470.50 5 
6 82 14.4 13.1 3136.58 9 
7 82 13.3 12.8 2799.55 8 
8 75 12.4 11.9 2565.50 6 
9 81 10.7 11.5 2429.49 11 

10 71 7.6 7.8 2369.37 6 

11 77 11.2 10.8 2644.62 7 

12 74 9.7 9.7 2647.45 9 

13 77 10.2 10.0 2672.92 7 

14 74 10.1 9.7 2640.25 8 

15 68 6.1 7.2 1926.60 5 


10.7 SUMMARY 


In this chapter we examine how the concepts and techniques of simple linear regression and 
correlation analysis are extended to the multiple-variable case. The least-squares method of 
obtaining the regression equation is presented and illustrated. This chapter also is 
concerned with the calculation of descriptive measures, tests of significance, and the 
uses to be made of the multiple regression equation. In addition, the methods and concepts 
of correlation analysis, including partial correlation, are discussed. 

When the assumptions underlying the methods of regression and correlation 
presented in this and the previous chapter are not met, the researcher must resort to 
alternative techniques such as those discussed in Chapter 13. 
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Formula 

Number Name Formula 

10.2.1 Representation of yj = Bo + Bix + Во + +++ Bag + 6 
the multiple 
linear regression 
equation 

10.2.2 Representation yj = Bo + Bixy + Boxy + 6j 


of the multiple 
linear regression 
equation with 
two independent 
variables 


(Continued ) 
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Random deviation 
of a point from a 
plane when there 
are two 
independent 
variables 


10.2.3 


єї = у; — Bo з Віху — Вх; 


10.3.1 Sum-of-squared 


residuals 


DULOXU -$y 


10.4.1 Sum-of-squares 


equation 


_\2 A A2 EZ 
y -X($-» -X(-3) 
SST = SSR + SSE 


2 O, 


10.4.2 Coefficient of 
multiple 


determination 


a E _SSR 
y.12...k mE 2 SST 
Em 


t statistic for 
testing hypotheses 
about В; 


10.4.3 


10.5.1 Estimation 
equation for 
multiple linear 


regression 


10.5.2 Confidence interval 
for the mean of Y 


for a given X 


Yj E f(17a/2),-k—155; 


10.5.3 Prediction interval 


for Y for a given X 


Ў 11-ау2) aki 5, 


10.6.1 Multiple 


correlation model 


y; = Bo + Вуху + Boxy ++ + Beg + 6j 


10.6.2 Multiple 
correlation 


coefficient 


F statistic for 
testing the multiple 
correlation 
coefficient 


10.6.3 


10.6.4—10.6.6 


Partial correlation 
between two 
variables (1 and 2) 
after controlling for 
a third (3) 


(1 = яз) (1 B 133) 


ri23 = (riy — 713723) / 
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10.6.7 t statistic for testing Hd 
hypotheses about t = 1y12...k Т 
partial correlation yas 
coefficients 

Symbol Key . B, — estimated regression/correlation coefficient x 


e В. = regression/correlation coefficient 

* € — model error term 

• k= number of independent variables 

e n= sample size 

є гүзз = sample partial correlation coefficient between 1 and 2 
after controlling for 3 

* R—sample correlation coefficient 

• R? = multiple coefficient of determination 

e роз [statistic 

* x;— value of independent variable at i 

* x — sample mean of independent variable 

* y;— value of dependent variable at i 

* y — sample mean of dependent variable 

• Y = estimated y 

e z = zstatistic 


REVIEW QUESTIONS AND EXERCISES 


1. Whatare the assumptions underlying multiple regression analysis when one wishes to infer about the 
population from which the sample data have been drawn? 


2. What are the assumptions underlying the correlation model when inference is an objective? 


3. Explain fully the following terms: 


(a) Coefficient of multiple determination (b) Multiple correlation coefficient 
(c) Simple correlation coefficient (d) Partial correlation coefficient 


4. Describe a situation in your particular area of interest where multiple regression analysis would be 
useful. Use real or realistic data and do a complete regression analysis. 


5. Describe a situation in your particular area of interest where multiple correlation analysis would be 
useful. Use real or realistic data and do a complete correlation analysis. 


In Exercises 6 through 11 carry out the indicated analysis and test hypotheses at the indicated 
significance levels. Compute the p value for each test. 


6. We learned in Example 9.7.1 that the purpose of a study by Kwast-Rabben et al. (А-6) was to analyze 
somatosensory evoked potentials (SEPs) and their interrelations following stimulation of digits I, Ш, 
and V in the hand. Healthy volunteers were recruited for the study. Researchers applied stimulation 
below-pain-level intensity to the fingers. Recordings of spinal responses were made with electrodes 
fixed by adhesive electrode cream to the subject’s skin. Results are shown in the following table for 
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114 subjects. Use multiple regression to see how well you can predict the peak spinal latency (Cv) of 
the SEP for digit I when age (years) and arm length (cm) are the predictor variables. Evaluate the 
usefulness of your prediction equation. 


Age Arm Length Cv Dig.I Age Arm Length Cv Dig.I Age Arm Length Cv Dig.I 


35.07 76.5 13.50 32.00 82.0 16.30 42.08 94.0 17.70 
35.07 76.5 13.50 32.00 82.0 15.40 40.09 94.0 17.70 
21.01 77.0 13.00 38.09 86.5 16.60 40.09 94.0 17.40 
21.01 77.0 13.60 38.09 86.5 16.00 42.09 92.5 18.40 
47.06 75.5 14.30 58.07 85.0 17.00 20.08 95.0 19.00 
47.06 75.5 14.90 58.07 85.0 16.40 50.08 94.5 19.10 
26.00 80.0 15.40 54.02 88.0 17.60 50.08 94.5 19.20 
26.00 80.0 14.70 48.10 92.0 16.80 47.11 97.5 17.80 
53.04 82.0 15.70 48.10 92.0 17.00 47.11 97.5 19.30 
53.04 82.0 15.80 54.02 88.0 17.60 26.05 96.0 17.50 
43.07 79.0 15.20 45.03 91.5 17.30 26.05 96.0 18.00 
39.08 83.5 16.50 45.03 91.5 16.80 43.02 98.0 18.00 
39.08 83.5 17.00 35.11 94.0 17.00 43.02 98.0 18.80 
43.07 79.0 14.70 26.04 88.0 15.60 32.06 98.5 18.30 
29.06 81.0 16.00 51.07 87.0 16.80 32.06 98.5 18.60 
29.06 81.0 15.80 51.07 87.0 17.40 33.09 97.0 18.80 
50.02 86.0 15.10 26.04 88.0 16.50 33.09 97.0 19.20 
25.07 81.5 14.60 35.11 94.0 16.60 35.02 100.0 18.50 
25.07 81.5 15.60 52.00 88.5 18.00 35.02 100.0 18.50 
25.10 82.5 14.60 44.02 90.0 17.40 26.05 96.0 19.00 
47.04 86.0 17.00 44.02 90.0 17.30 26.05 96.0 18.50 
47.04 86.0 16.30 24.05 91.0 16.40 25.08 100.5 19.80 
37.00 83.0 16.00 24.00 87.0 16.10 25.06 100.0 18.80 
37.00 83.0 16.00 24.00 87.0 16.10 25.06 100.0 18.40 
34.10 84.0 16.30 24.00 87.0 16.00 25.08 100.5 19.00 
47.01 87.5 17.40 24.00 87.0 16.00 30.05 101.0 18.00 
47.01 87.5 17.00 53.05 90.0 17.50 30.05 101.0 18.20 
30.04 81.0 14.10 53.05 90.0 17.50 36.07 104.5 18.90 
23.06 81.5 14.20 52.06 90.0 18.00 36.07 104.5 19.20 
23.06 81.5 14.70 52.06 90.0 17.90 35.09 102.0 21.00 
30.04 81.0 13.90 53.04 93.0 18.40 35.09 102.0 19.20 
78.00 81.0 17.20 22.04 90.0 16.40 21.01 101.5 18.60 
41.02 83.5 16.70 22.04 90.0 15.80 21.01 101.5 18.60 
41.02 83.5 16.50 46.07 95.5 18.80 40.00 95.5 20.00 
28.07 78.0 14.80 46.07 95.5 18.60 42.09 92.5 18.40 
28.07 78.0 15.00 47.00 93.5 18.00 42.08 94.0 18.50 
36.05 88.0 17.30 47.00 93.5 17.90 35.04 86.0 16.00 
35.04 86.0 15.30 39.05 94.5 17.40 36.05 88.0 16.60 


Source: Data provided courtesy of Olga Kwast-Rabben, Ph.D. 


7. The following table shows the weight and total cholesterol and triglyceride levels in 15 patients with 
primary type II hyperlipoproteinemia just prior to initiation of treatment: 
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Ху X5 

Total Cholesterol Triglyceride 

Y Weight (kg) (mg/100 ml) (mg/100 ml) 
76 302 139 
97 336 101 
83 220 57 
52 300 56 
70 382 113 
67 379 42 
75 331 84 
78 332 186 
70 426 164 
99 399 205 
75 279 230 
78 332 186 
70 410 160 
77 389 153 
76 302 139 


Compute the multiple correlation coefficient and test for significance at the .05 level. 


In a study of the relationship between creatinine excretion, height, and weight, the data shown in the 
following table were collected on 20 infant males: 


Creatinine 
Excretion 
(mg/day) Weight (kg) Height (cm) 
Infant Y Хі Х, 
1 100 9 72 
2 115 10 76 
3 52 6 59 
4 85 8 68 
5 135 10 60 
6 58 5 58 
7 90 8 70 
8 60 7 65 
9 45 4 54 
10 125 11 83 
11 86 7 64 
12 80 7 66 
13 65 6 61 
14 95 8 66 
15 25 5 57 
16 125 11 81 
17 40 5 59 


(Continued ) 
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10. 


Creatinine 
Excretion 
(mg/day) Weight (kg) Height (cm) 
Infant Y Xi X5 
18 95 9 71 
19 70 6 62 
20 120 10 75 


(a) Find the multiple regression equation describing the relationship among these variables. 
(b) Compute R? and do an analysis of variance. 
(c) Let X, = 10 and X2 = 60 and find the predicted value of Y 


A study was conducted to examine those variables thought to be related to the job satisfaction of 
nonprofessional hospital employees. A random sample of 15 employees gave the following 
results: 


Coded Index of 
Score on Job Intelligence Personal 
Satisfaction Score Adjustment 
Test (Y) (Хі) (X2) 
54 15 8 
37 13 1 
30 15 1 
48 15 7 
37 10 4 
37 14 2 
31 8 3 
49 12 7 
43 1 9 
12 3 1 
30 15 1 
37 14 2 
61 14 10 
31 9 1 
31 4 5 


(a) Find the multiple regression equation describing the relationship among these variables. 

(b) Compute the coefficient of multiple determination and do an analysis of variance. 

(c) Let X, = 10 and X = 5 and find the predicted value of Y. 

A medical research team obtained the index of adiposity, basal insulin, and basal glucose values on 21 


normal subjects. The results are shown in the following table. The researchers wished to investigate 
the strength of the association among these variables. 


11. 
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Index of Basal Insulin Basal Glucose 
Adiposity (U/ml) (mg/100 ml) 
Y Xi X3 
90 12 98 
112 10 103 
127 14 101 
137 11 102 
103 10 90 
140 38 108 
105 9 100 
92 6 101 
92 8 92 
96 6 91 
114 9 95 
108 9 95 
160 41 117 
91 7 101 
115 9 86 
167 40 106 
108 9 84 
156 43 117 
167 17 99 
165 40 104 
168 22 85 


Compute the multiple correlation coefficient and test for significance at the .05 level. 


As part of a study to investigate the relationship between stress and certain other variables, the 
following data were collected on a simple random sample of 15 corporate executives. 


(a) Find the least-squares regression equation for these data. 


(b) Construct the analysis of variance table and test the null hypothesis of no relationship among the 
five variables. 


(c) Test the null hypothesis that each slope in the regression model is equal to zero. 


(d) Find the multiple coefficient of determination and the multiple correlation coefficient. Let 
о = .05 and find the p value for each test. 


Annual 
Measure of Number of Years Salary 
Measure of Firm Size in Present (x1000) 
Stress (Y) (Хі) Position (X5) (X3) Age (X4) 
101 812 15 $30 38 
60 334 8 20 52 
10 377 5 20 27 
27 303 10 54 36 


(Continued ) 
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12. 


13. 


Annual 
Measure of Number of Years Salary 

Measure of Firm Size in Present (x1000) 

Stress (Y) (Хі) Position (X2) (X3) Age (X4) 
89 505 13 52 34 
60 401 4 21 45 
16 177 6 26 50 

184 598 9 52 60 
34 412 16 34 44 
17 127 2 28 39 
78 601 8 42 41 

141 297 11 84 58 
11 205 4 31 51 

104 603 5 38 63 
76 484 8 41 30 


For each of the studies described in Exercises 12 through 16, answer as many of the following 
questions as possible: 


(a) Which is more relevant, regression analysis or correlation analysis, or are both techniques 
equally relevant? 


(b) Which is the dependent variable? 

(c) What are the independent variables? 

(d) What are the appropriate null and alternative hypotheses? 
(e) Which null hypotheses do you think were rejected? Why? 


(f) Which is the more relevant objective, prediction or estimation, or are the two equally relevant? 
Explain your answer. 


(g) What is the sampled population? 
(h) What is the target population? 


(i) Which variables are related to which other variables? Are the relationships direct or 
inverse? 


(j) Write out the regression equation using appropriate numbers for parameter estimates. 
(k) What is the numerical value of the coefficient of multiple determination? 


(1) Give numerical values for any correlation coefficients that you can. 


Hashimoto et al. (A-7) developed a multiple regression model to predict the number of visits to 
emergency rooms at Jikei University hospitals in Tokyo for children having an asthma attack. The 
researchers found that the number of visits per night increased significantly when climate conditions 
showed a rapid decrease from higher barometric pressure, from higher air temperature, and from 
higher humidity, as well as lower wind speed. The final model demonstrated that 22 percent of the 
variation in the number of visits was explained by variation in the predictor variables mentioned 
above with eight other significant climate variables. 


Correlation was one of many procedures discussed in a study reported by Stenvinkel et al. (A-8). In a 
cohort of 204 subjects with end-stage renal disease, they found no significant correlations between 
log plasma adiponectin levels and age and no significant correlation between log plasma adiponectin 
and glomerular filtration rate. 


14. 


15. 


16. 


17. 
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Van Schuylenbergh et al. (A-9) used physiological and anthropometric measurements as independent 
variables to predict triathlon performance (expressed in minutes). Ten triathletes underwent 
extensive physiological testing in swimming, cycling, and running. Within 2 weeks after the last 
laboratory test, all subjects competed in the National University Triathlon Championship. The final 
regression model was 


TP = 130 — 9.2MLSSR — 25.9MLSSS + 1.4BLCR 


in which TP — triathlon performance in minutes, MLSSR — the running speed at MLSS (m/s), 
MLSSS = the swimming speed at MLSS, and BLCR = blood lactate concentration at running MLSS 
(mmol/L). MLSS refers to maximal lactate steady state and is generally acknowledged to be a good 
marker of functional aerobic power during prolonged exercise. It also differs for each physical 
activity. For the above model R? — .98. 


Maximal static inspiratory (Pimax) mouth pressure is a simple measurement of respiratory muscle 
strength. A study by Tomalak et al. (A-10) examined correlations among the variables with Pimax 
(measured sitting), forced expiratory volume (FEV), peak expiratory flow (PEF), and maximal 
inspiratory flow (PIF) in 144 boys and 152 girls ages 7-14. The researchers found Pimax was 
correlated with FEV, PEF, and PIF in boys (p — .001, p — .0055, and p — .002, respectively) and for 
girls the correlations were also significant (p « .001, p « .001, and p « .001, respectively). 


Di Monaco et al. (A-11) used multiple regression to predict bone mineral density of the femoral neck 
(among other locations). Among 124 Caucasian, healthy postmenopausal women, they found that 
weight (p « .001), age (p « .01), and total lymphocyte count (p « .001) were each useful in 
predicting bone mineral density. In addition, R? — .40. 


For each of the data sets given in Exercises 17 through 19, do as many of the following as you think 
appropriate: 

(a) Obtain the least-squares multiple regression equation. 

(b) Compute the sample coefficient of multiple determination. 

(c) Compute the sample coefficient of multiple correlation. 

(d) Compute simple coefficients of determination and correlation. 

(e) Compute partial correlation coefficients. 

(f) Construct graphs. 

(g) Formulate relevant hypotheses, perform the appropriate tests, and find p values. 

(h) State the statistical decisions and clinical conclusions that the results of your hypothesis tests 
justify. 

(i) Use your regression equations to make predictions and estimates about the dependent variable 
for your selected values of the independent variables. 

(j) Construct confidence intervals for relevant population parameters. 


(k) Describe the population(s) to which you think your inferences are applicable. 


Pellegrino et al. (A-12) hypothesized that maximal bronchoconstriction can be predicted from the 
bronchomotor effect of deep inhalation and the degree of airway sensitivity to methacholine 
(MCh). One group of participants consisted of 26 healthy or mildly asthmatic subjects (22 males, 
4 females) who had limited bronchoconstriction to inhaled MCh. The mean age of the patients was 
31 years with a standard deviation of 8. There was one smoker in the group. Among the data 
collected on each subject were the following observations on various lung function measurement 
variables: 
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(X) (X3) (Хв) (5) (Хз) (№) (Xi) || (Хі) FEV, . (Xv) ‚ (Хз) 
(X) FEV,  FEVi/ (Ха) (Xs) M/P MP PD,;FEV,  РОдо У mso PDa4yVps, Мах decr Vmso Мах Ур» Мах 
FEV, %Pred FVC,% Ушу Ур» Ratio Slope (In mg) (In mg) (In mg) (70) decr(%) decr(%) 
5.22 08.75 83.92 5.30 3.90 136 0.75 8.44 824 6.34 21.40 55.40 74.40 
5.38 23.96 78.54 6.00 3.70 1.62 0.56 7.76 7.00 6.18 15.80 50.80 85.14 
3.62 11.04 86.19 3.10 2.85 1.10 0.69 6.92 6.61 5.56 30.40 54.36 83.07 
3.94 9426 85.28 410 2.70 1.52 044 6.79 8.52 6.38 16.40 29.10 58.50 
4.48 0443 76.58 321 3.00 1.07 0.63 8.79 9.74 6.68 27.80 46.30 76.70 
5.28 17.33 81.99 5.65 5.55 1.02 0.83 8.98 8.97 8.19 32.60 70.80 90.00 
3.80 93.37 76.61 3.75 4.10 0.80 0.50 10.52 10.60 10.04 15.80 35.30 64.90 
3.14 04.67 82.63 320 320 1.00 0.70 6.18 6.58 6.02 37.60 64.10 87.50 
5.26 20.00 84.84 630 7.40 0.89 0.55 11.85 11.85 11.85 11.70 29.10 41.20 
4.87 21.14 89.69 5.50 5.50 1.00 0.56 11.85 11.85 11.85 10.30 16.40 29.70 
5.35 ЗАЛІ 84.65 5.60 7.00 0.80 0.40 11.98 11.98 11.29 0.00 18.00 47.20 
4.30 95.98 80.37 5.78 490 1.18 0.59 6.48 6.19 5.11 17.00 48.20 79.60 
3.75 87.82 65.79 2.26 1.65 137 0.53 6.25 7.02 5.03 27.10 39.53 81.80 
4.41 12.21 69.78 3.19 2.95 1.08 0.57 7.66 8.08 5.51 24.70 48.80 85.90 
4.66 08.37 78.72 5.00 5.90 0.85 0.49 7.79 9.77 6.10 15.00 35.00 70.30 
5.19 99.05 73.62 420 1.50 2.80 0.63 5.15 5.78 4.72 31.40 61.90 86.70 
4.32 22.38 | 75.13 4.39 330 133 0.74 6.20 6.34 5.10 28.25 60.30 78.00 
4.05 95.97 8438 3.40 2.50 1.30 0.59 5.64 8.52 5.61 18.20 29.50 46.00 
3.23 8825 8730 4.00 4.00 1.00 071 347 3.43 2.77 21.60 64.50 86.00 
3.99 05.56 8674 5.30 2.70 1.96 0.76 6.40 5.20 6.17 22.50 63.00 77.80 
4.37 02.34 80.18 320 1.80 177 0.85 5.05 4.97 5.2 35.30 57.00 78.00 
2.67 68.11 65.12 170 1.30 138 0.91 3.97 3.95 4.11 32.40 58.80 82.40 
4.75 03.71 73.08 4.60 3.60 1.21 0.71 6.34 5.29 6.04 18.85 47.50 72.20 
3.19 8812 85.07 3.20 1.80 1.77 0.76 5.08 4.85 5.16 36.20 83.40 93.00 
3.29 02.17 92.68 3.80 240 1.58 0.50 821 6.90 10.60 21.60 28.10 66.70 
2.87 95.03 95.67 3.00 3.00 100 075 6.24 5.99 7.50 27.00 46.70 68.30 


V msg and Ур = maximal and partial forced expiratory flows at 50 percent of control FVC; M/P ratio = ratio of Vms to Уру аї 
control; MP slope = slope of the regression of percent decrements of Уту and Уру recorded during the MCh inhalation challenge; 
PD,5FEV, = dose of MCh that decreased FEV, by 15 percent of control; PD49 Vmso and PD, Урі — doses of MCh that decreased 
Vmso and Vpso by 40 percent of control respectively; % max decr = percent maximal decrement at plateau.Source: Data provided 
courtesy of Dr. Riccardo Pellegrino. 


The purpose of a study by O'Brien et al. (A-13) was to assess hypothalamic-pituitary-adrenal 
(HPA) axis function (known to be altered in depression) in patients with Alzheimer's disease (AD) 
by means of the adrenocorticotrophic hormone (ACTH) test, which assesses adrenal function by 
measuring cortisol production by the adrenal gland in response to an injection of ACTH. AD 
subjects (mean age 69.9 years with standard deviation of 9.8) were recruited from referrals to a 
hospital memory clinic. Normal control subjects consisted of spouses of patients and residents of a 
retirement hostel (mean age 73.8 with standard deviation of 11.6). There were eight males and 
eight females in the AD group and 10 males and eight females in the control group. Among the 
data collected were the following observations on age (C1), age at onset for AD subjects (C2), 
length of history of disease in months (C3), cognitive examination score (C4), peak cortisol level 
(C5), and total hormone response (C6): 
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Alzheimer's Disease Subjects Controls 
C1 C2 C3 C4 C5 C6 C1 C2 C3 C4 C5 C6 
73 69 48 75 400.00 44610 70 й t 97 419.00 53175 
87 83 48 39 565.00 63855 81 * Ы 93 470.00 54285 
60 54 72 67 307.00 31110 82 M Y 93 417.00 47160 
62 57 60 64 335.00 36000 57 i к 101 215.00 27120 
75 70 48 51 352.00 44760 87 M ° 91 244.00 23895 
63 60 24 79 426.00 47250 88 > Ы 88 355.00 33565 
81 77 48 51 413.00 51825 87 E M 9] 392.00 42810 
66 64 24 61 402.00 41745 70 i ° 100 354.00 45105 
78 73 60 32 518.00 66030 63 у 5 103 457.00 48765 
72 64 72 61 505.00 49905 87 M ^ 81 323.00 39360 
69 65 48 73 427.00 55350 73 г 7 94 386.00 48150 
76 73 36 63 409.00 51960 87 7 ч 91 244.00 25830 
46 41 60 73 333.00 33030 58 5 $ 103 353.00 42060 
77 75 18 63 591.00 73125 85 * А 93 335.00 37425 
64 61 36 59 559.00 60750 58 M : 99 470.00 55140 
72 69 30 47 511.00 54945 67 Е * 100 346.00 50745 
68 » А 100 262.00 28440 
62 а S 93 271.00 23595 


* =Not applicable. 
Source: Data provided courtesy 


of Dr. John T. O'Brien. 


Johnson et al. (A-14) note that the ability to identify the source of remembered information is a 
fundamental cognitive function. They conducted an experiment to explore the relative contribution of 
perceptual cues and cognitive operations information to age-related deficits in discriminating 
memories from different external sources (external source monitoring). Subjects for the experiment 
included 96 graduate and undergraduate students (41 males and 55 females) ranging in ages from 18 
to 27 years. Among the data collected were the following performance recognition scores on source 
monitoring conditions (C1, C2, C3) and scores on the Benton Facial Recognition Test (C4), the 
Wechsler Adult Intelligence Scale—Revised (WAIS-R), WAIS-R Block Design subscale (C5), 
WAIS-R Vocabulary subscale (C6), the Benton Verbal Fluency Test (C7), and the Wisconsin Card 
Sorting Test (C8): 


C1 C2 C3 C4 C5 C6 C7 C8 
0.783 2.63 0.808 25 38 62 67 6 
0.909 3.36 0.846 i » 50 И i 
0.920 2.14 0.616 23 25 53 47 6 
0.727 3.36 0.846 25 40 49 58 6 
0.737 2.93 0.731 Я К 59 Е * 
0.600 4.07 0.962 19 50 51 35 6 
0.840 3.15 0.885 i й 57 Ё * 
0.850 3.06 0.769 ^ у 55 Е 
0.875 3.72 0.923 24 23 52 35 6 
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C1 


0.792 
0.680 
0.731 
0.826 
0.609 
0.923 
0.773 
0.714 
0.667 
0.769 
0.565 
0.824 
0.458 
0.840 
0.720 
0.917 
0.560 
0.840 
0.720 
0.783 
0.696 
0.625 
0.737 
0.900 
0.565 
0.680 
0.760 
0.958 
0.652 
0.560 
0.500 
0.826 
0.783 
0.783 
0.750 
0.913 
0.952 
0.800 
0.870 
0.652 
0.640 
0.692 
0.917 
0.760 
0.739 


C2 


3.15 
4.07 
4.64 
1.84 
2.98 
4.64 
3.36 
1.62 
3.72 
1.40 
3.55 
1.78 
1.90 
4.07 
4.07 
3.72 
4.07 
4.07 
4.07 
1.74 
1.62 
3.72 
1.12 
1.92 
3.55 
4.07 
4.07 
1.90 
2.98 
4.07 
1.92 
2.63 
2.58 
2.63 
2.14 
2.11 
1.49 
4.07 
3.55 
1.97 
4.07 
4.64 
3.72 
4.07 
3.55 


C3 


0.884 
0.962 
1.000 
0.616 
0.846 
1.000 
0.846 
0.577 
0.923 
0.423 
0.885 
0.577 
0.615 
0.962 
0.962 
0.923 
0.926 
0.962 
0.962 
0.577 
0.539 
0.923 
0.423 
0.654 
0.885 
0.962 
0.962 
0.615 
0.846 
0.962 
0.654 
0.808 
0.808 
0.808 
0.692 
0.693 
0.539 
0.962 
0.885 
0.654 
0.962 
1.000 
0.923 
0.962 
0.885 
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C7 C8 
47 
42 6 
28 6 
47 
37 6 
40 6 
40 6 
42 6 
64 6 
43 6 
46 
58 6 
36 6 
54 6 
25 6 
33 6 
43 6 
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C1 


0.857 
0.727 
0.833 
0.840 
0.478 
0.920 
0.731 
0.920 
0.720 
1.000 
0.708 
1.000 
0.739 
0.600 
0.962 
0.772 
0.800 
0.923 
0.870 
0.808 
1.000 
0.870 
0.923 
0.958 
0.826 
0.962 
0.783 
0.905 
1.000 
0.875 
0.885 
0.913 
0.962 
0.682 
0.810 
0.720 
0.875 
0.923 
0.909 
0.920 
1.000 
0.609 


C2 


3.20 
3.36 
2.80 
4.07 
2.27 
4.07 
4.64 
4.07 
4.07 
2.79 
3.72 
4.64 
3:55 
420 
4.64 
2.22 
2.92 
4.64 
3.50 
4.64 
4.07 
3.55 
4.64 
2.58 
3.50 
3.72 
3.50 
3.20 
4.64 
3.72 
4.07 
2.92 
4.07 
3.36 
2.63 
2.79 
2.80 
3.72 
3.36 
4.07 
3-12. 
3.50 


СЗ 


0.808 
0.846 
0.846 
0.962 
0.731 
0.962 
1.000 
0.962 
0.962 
0.807 
0.923 
1.000 
0.885 
0.962 
1.000 
0.731 
0.847 
1.000 
0.885 
1.000 
0.962 
0.885 
1.000 
0.808 
0.885 
0.923 
0.885 
0.808 
1.000 
0.923 
0.962 
0.846 
0.961 
0.846 
0.769 
0.808 
0.846 
0.924 
0.846 
0.962 
0.923 
0.885 


C6 


59 
61 
56 
49 
60 
64 
51 
61 
57 
56 
57 
55 
57 
57 
63 
51 
47 
54 
54 
57 
59 
61 
52 
52 
61 
57 
60 
55 
57 
55 
52 
57 
54 
61 
57 
64 
59 
58 
56 
52 
64 
49 


REVIEW QUESTIONS AND EXERCISES 


чө 


* 


* С\ С\ > AAAA QOO оо С\ С СО о ОС СО ОСО, ааа 


С С С С ОХ МЮ тет 


* = Missing data. 
Source: Data provided courtesy of Dr. Doreen M. De Leonardis. 
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Exercises for Use with the Large Data Sets Available on the Following Website: 
www.wiley.com/college/daniel 


. Winters et al. (A-15) conducted a study involving 248 high-school students enrolled in 


introductory physical education courses. The researchers wanted to know if social cognitive 
theory constructs were correlated with discretionary, “leisure-time” physical exercise. The main 
outcome variable is STREN, which is the number of days in a week that a high-school student 
engaged in strenuous physical activity (operationally defined as exercise that results in sweating, 
labored breathing, and rapid heart rate). Students in the study filled out lengthy questionnaires 
from which the following variables were derived: 


SELFR100— measures personal regulation of goal-directed behavior (higher values indicate 
more goal oriented). 

SS100—measures social support, social encouragement, and social expectation that are 
provided by friends and family for physical exercise (higher values indicate more support). 

SSE100—measures perceived ability to overcome barriers to exercise (higher values indicate 
higher ability). 

OEVNORM —measures outcome expectations and their associated expectancies for physical 
exercise (higher values indicate stronger perceived links to desired outcomes from exercise). 


With these data (LTEXER), 

(a) Calculate the bivariate correlation for each pair of variables and interpret the meaning of 
each. 

(b) Using STREN as the dependent variable, compute the multiple correlation coefficient. 
(c) Using STREN as the dependent variable, calculate the partial correlation coefficient for 
STREN and SELFR100 after controlling for 55100. 

(d) Using STREN as the dependent variable, calculate the partial correlation coefficient for 
STREN and 55Е100 after controlling for OEVNORM. 


Note that there many missing values in this data set. 


. With data obtained from a national database on childbirth, Matulavich et al. (A-16) examined the 


number of courses of prescribed steroids a mother took during pregnancy (STEROIDS). The size 
of the baby was measured by length (cm), weight (grams), and head circumference (cm). 
Calculate the correlation of the number of courses of steroids with each of the three outcome 
variables. What are the hypotheses for your tests? What are the p-values? What are your 
conclusions? (The name of the data set is STERLENGTH.) 


. Refer to the data on cardiovascular risk factors (RISKFACT). The subjects are 1000 males 


engaged in sedentary occupations. You wish to study the relationships among risk factors in this 
population. The variables are 


Y — oxygen consumption 
X; = systolic blood pressure (mm Hg) 
X» = total cholesterol (mg/dl) 
Хз = HDL cholesterol (mg/dl) 
X4 — triglycerides (mg/dl) 


Select a simple random sample from this population and carry out an appropriate statistical 
analysis. Prepare a narrative report of your findings and compare them with those of your 
classmates. Consult with your instructor regarding the size of the sample. 
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4. Refer to the data on 500 patients who have sought treatment for the relief of respiratory disease 
symptoms (RESPDIS). A medical research team is conducting a study to determine what factors 
may be related to respiratory disease. The dependent variable Y is a measure of the severity of the 
disease. A larger value indicates a more serious condition. The independent variables are as 
follows: 


X, — education (highest grade completed) 

X; = measure of crowding of living quarters 

Хз = measure of air quality at place of residence (a larger number indicates poorer quality) 
X4 — nutritional status (a large number indicates a higher level of nutrition) 


Xs — smoking status (0 — smoker, 1 — nonsmoker) 


Select a simple random sample of subjects from this population and conduct a statistical analysis 
that you think would be of value to the research team. Prepare a narrative report of your results 
and conclusions. Use graphic illustrations where appropriate. Compare your results with those of 
your classmates. Consult your instructor regarding the size of sample you should select. 
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REGRESSION ANALYSIS: 
SOME ADDITIONAL TECHNIQUES 


CHAPTER OVERVIEW 


This chapter provides an introduction to some additional tools and concepts 
thatare useful in regression analysis. The presentation includes expansions of 
the basic ideas and techniques of regression analysis that were introduced in 
Chapters 9 and 10. 


TOPICS 
11.1 INTRODUCTION 
11.2 QUALITATIVE INDEPENDENT VARIABLES 
11.3 VARIABLE SELECTION PROCEDURES 
11.4 LOGISTIC REGRESSION 
11.5 SUMMARY 


LEARNING OUTCOMES 


After studying this chapter, the student will 
1. understand how to include qualitative variables in a regression analysis. 


2. understand how to use automated variable selection procedures to develop 
regression models. 


3. be able to perform logistic regression for dichotomous and polytomous depen- 
dent variables. 
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11.1 


INTRODUCTION 


The basic concepts and methodology of linear regression analysis are covered in 
Chapters 9 and 10. In Chapter 9 we discuss the situation in which the objective is to 
obtain an equation that can be used to make predictions and estimates about some 
dependent variable from knowledge of some other single variable that we call the 
independent, predictor, or explanatory variable. In Chapter 10 the ideas and techniques 
learned in Chapter 9 are expanded to cover the situation in which it is believed that the 
inclusion of information on two or more independent variables will yield a better equation 
for use in making predictions and estimations. Regression analysis is a complex and 
powerful statistical tool that is widely employed in health sciences research. To do the 
subject justice requires more space than is available in an introductory statistics textbook. 
However, for the benefit of those who wish additional coverage of regression analysis, we 
present in this chapter some additional topics that should prove helpful to the student and 
practitioner of statistics. 


Regression Assumptions Revisited As we learned in Chapters 9 and 10, 
there are several assumptions underlying the appropriate use of regression procedures. 
Often there are certain measurements that strongly influence the shape of a distribution 
or impact the magnitude of the variance of a measured variable. Other times, certain 
independent variables that are being used to develop a model are highly correlated, leading 
to the development of a model that may not be unique or correct. 


Non-Normal Data Many times the data that are used to build a regression model 
are not normally distributed. One may wish to explore the possibility that some of the 
Observed data points are outliers or that they disproportionately affect the distribution of 
the data. Such an investigation may be accomplished informally by constructing a scatter 
plot and looking for observations that do not seem to fit with the others. Alternatively, 
many computer packages produce formal tests to evaluate potential outlying observa- 
tions in either the dependent variable or the independent variables. It is always up to the 
researcher, however, to justify which observations are to be removed from the data set 
prior to analysis. 

Often one may wish to attempt a transformation of the data. Mathematical transfor- 
mations are useful because they do not affect the underlying relationships among variables. 
Since hypothesis tests for the regression coefficients are based on normal distribution 
statistics, data transformations can sometimes normalize the data to the extent necessary to 
perform such tests. Simple transformations, such as taking the square root of measurements 
or taking the logarithm of measurements, are quite common. 


EXAMPLE 11.1.1 


Researchers were interested in blood concentrations of delta-9-tetrahydrocannabinol 
(A-9-THC), the active psychotropic component in marijuana, from 25 research subjects. 
These data are presented in Table 11.1.1, as are these same data after using a logio 
transformation. 
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TABLE 11.1.1 Data from a Random Sample of 25 Research 
Subjects Tested for A-9-THC, Example 11.1.1 


Case No. Concentration (ug/ml) Log:o Concentration (ug/ml) 
1 .30 —.52 
2 2.75 44 
3 2.27 .36 
4 2.37 .37 
5 1.12 .05 
6 .60 —.22 
7 .61 —.21 
8 .89 —.05 
9 .33 —.48 

10 .85 —.07 

11 2.18 .34 

12 3.59 .56 

13 .28 —.55 

14 1.90 .28 

15 1.71 .23 

16 85 —.07 

17 1.53 .18 

18 2.25 .35 

19 .88 —.05 

20 .49 —.31 

21 4.35 .64 

22 .67 —.17 

23 2.74 .44 

24 .79 -.10 

25 6.94 .84 


Box-and-whisker plots from SPSS software for these data are shown in Figure 11.1.1. The 
raw data are clearly skewed, and an outlier is identified (observation 25). A 1000 transfor- 
mation, which is often useful for such skewed data, removes the magnitude of the outlier and 
results in a distribution that is much more nearly symmetric about the median. Therefore, the 
transformed data could be used in lieu of the raw data for constructing the regression model. 
Though symmetric data do not, necessarily, imply that the data are normal, they do result in a 
more appropriate model. Formal tests of normality, as previously mentioned, should always 
be carried out prior to analysis. и 


Unequal Error Variances When the variances of the error terms are not equal, we 
may obtain a satisfactory equation for the model, but, because the assumption that the error 
variances are equal is violated, we will not be able to perform appropriate hypothesis tests on 
the model coefficients. Just as was the case in overcoming the non-normality problem, 
transformations ofthe regression variables may reduce the impact of unequal error variances. 
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FIGURE 11.1.1 Box-and-whisker plots of data from Example 11.1.1. 


Correlated Independent Variables Multicollinearity is a common problem that 
arises when one attempts to build a model using many independent variables. Multicolli- 
nearity occurs when there is a high degree of correlation among the independent variables. For 
example, imagine that we want to find an equation relating height and weight to blood 
pressure. A common variable that is derived from height and weight is called the body mass 
index (BMI). If we attempt to find an equation relating height, weight, and BMI to blood 
pressure, we can expect to run into analytical problems because BMI, by definition, is highly 
correlated with both height and weight. 

The problem arises mathematically when the solutions for the regression coefficients 
are derived. Since the data are correlated, solutions may not be found that are unique to a 
given model. The least complex solution to multicollinearity is to calculate correlations 
among all of the independent variables and to retain only those variables that are not highly 
correlated. A conservative rule of thumb to remove redundancy in the data set is to 
eliminate variables that are related to others with a significant correlation coefficient 
above 0.7. 


EXAMPLE 11.1.2 


A study of obesity and metabolic syndrome used data collected from 15 students, and 
included systolic blood pressure (SBP), weight, and BMI. These data are presented in 
Table 11.1.2. 

Correlations for the three variables are shown in Figure 11.1.2. The very large and 
significant correlation between the variables weight and BMI suggests that including both 
of these variables in the model is inappropriate because of the high level of redundancy in 
the information provided by these variables. This makes logical sense since BMI is a 
function of weight. The researcher is now faced with the task of deciding which of the 
variables to retain for constructing the regression model. 
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TABLE 11.1.2 Data from 8 Random Sample of 15 


Students 

Case No. SBP Weight (Ibs.) BMI 
1 126 125 24.41 
2 129 130 23.77 
3 126 132 20.07 
4 123 200 27.12 
5 124 321 39.07 
6 125 100 20.90 
7 127 138 22.96 
8 125 138 24.44 
9 123 149 23.33 
10 119 180 25.82 
11 127 184 26.40 
12 126 251 31.37 
13 122 197 26.72 
14 126 107 20.22 
15 125 125 23.62 


Correlations: SBP, Weight, BMI 


Weight 


Weight 
p-value 


BMI 
p-value 


FIGURE 11.1.2 Correlations calculated in MINITAB software for the data in Example 11.1.2. 
ш 


11.2 QUALITATIVE INDEPENDENT 
VARIABLES 


The independent variables considered in the discussion in Chapter 10 were all quantitative; 
that is, they yielded numerical values that were either counts or measurements in the usual 
sense of the word. For example, some of the independent variables used in our examples 
and exercises were age, education level, collagen porosity, and collagen tensile strength. 
Frequently, however, it is desirable to use one or more qualitative variables as independent 
variables in the regression model. Qualitative variables, it will be recalled, are those 
variables whose *values" are categories and that convey the concept of attribute rather than 
amount or quantity. The variable marital status, for example, is a qualitative variable whose 
categories are “single,” “married,” “widowed,” and "divorced." Other examples of 
qualitative variables include sex (male or female), diagnosis, race, occupation, and 
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immunity status to some disease. In certain situations an investigator may suspect that 
including one or more variables such as these in the regression equation would contribute 
significantly to the reduction of the error sum of squares and thereby provide more precise 
estimates of the parameters of interest. 

Suppose, for example, that we are studying the relationship between the dependent 
variable systolic blood pressure and the independent variables weight and age. We might 
also want to include the qualitative variable sex as one of the independent variables. Or 
suppose we wish to gain insight into the nature of the relationship between lung capacity 
and other relevant variables. Candidates for inclusion in the model might consist of such 
quantitative variables as height, weight, and age, as well as qualitative variables such 
as sex, area of residence (urban, suburban, rural), and smoking status (current smoker, 
ex-smoker, never smoked). 


Dummy Variables In order to incorporate a qualitative independent variable 
in the multiple regression model, it must be quantified in some manner. This may be 
accomplished through the use of what are known as dummy variables. 


DEFINITION 


A dummy variable is a variable that assumes only a finite number of 
values (such as 0 or 1) for the purpose of identifying the different 
categories of a qualitative variable. 


The term “dummy” is used to indicate the fact that the numerical values (such as 
0 and 1) assumed by the variable have no quantitative meaning but are used merely to 
identify different categories of the qualitative variable under consideration. Qualitative 
variables are sometimes called indicator variables, and when there are only two categories, 
they are sometimes called dichotomous variables. 

The following are some examples of qualitative variables and the dummy variables 
used to quantify them: 


Qualitative Variable Dummy Variable 
Sex (male, female): . J 1for male 
*! = 5 Ofor female’ 


Place of residence (urban, rural, suburban): 1 for urban 


O for rural and suburban ` 


1 for rural 
Ofor urban and suburban ` 


Smoking status [current smoker, ex-smoker 
(has not smoked for 5 years or less), ex-smoker 
(has not smoked for more than 5 years), never smoked]: 


О Ғог otherwise 


Il 


x 
№ 
xi 
1 for ex-smoker( < 5 years) 
х2 5 А 
O otherwise 
1 for ex-smoker(> 5 years) 
X3 E б 
E 0 otherwise 


{ 1 for current smoker 
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Note in these examples that when the qualitative variable has k categories, k — 1 
dummy variables must be defined for all the categories to be properly coded. This rule is 
applicable for any multiple regression containing an intercept constant. The variable sex, 
with two categories, can be quantified by the use of only one dummy variable, while three 
dummy variables are required to quantify the variable smoking status, which has four 
categories. 

The following examples illustrate some of the uses of qualitative variables in 
multiple regression. In the first example we assume that there is no interaction between 
the independent variables. Since the assumption of no interaction is not realistic in many 
instances, we illustrate, in the second example, the analysis that is appropriate when 
interaction between variables is accounted for. 


EXAMPLE 11.2.1 


In a study of factors thought to be associated with birth weight, a simple random sample of 
100 birth records was selected from the North Carolina 2001 Birth Registry (A-1). 
Table 11.2.1 shows, for three variables, the data extracted from each record. There are 
two independent variables: length of gestation (weeks), which is quantitative, and 
smoking status of mother (smoke), a qualitative variable. The dependent variable is birth 
weight (grams). 


TABLE 11.2.1 Data from a Simple Random Sample of 100 Births from the 
North Carolina Birth Registry, Example 11.2.1 


Case No. Grams Weeks Smoke Case No. Grams Weeks Smoke 
1 3147 40 0 51 3232 38 0 
2 2977 41 0 52 3317 40 0 
3 3119 38 0 53 2863 37 0 
4 3487 38 0 54 3175 37 0 
5 4111 39 0 55 3317 40 0 
6 3572 41 0 56 3714 34 0 
7 3487 40 0 57 2240 36 0 
8 3147 41 0 58 3345 39 0 
9 3345 38 1 59 3119 39 0 

10 2665 34 0 60 2920 37 0 

11 1559 34 0 61 3430 41 0 

12 3799 38 0 62 3232 35 0 

13 2750 38 0 63 3430 38 0 

14 3487 40 0 64 4139 39 0 

15 3317 38 0 65 3714 39 0 

16 3544 43 1 66 1446 28 1 

17 3459 45 0 67 3147 39 1 

18 2807 37 0 68 2580 31 0 

19 3856 40 0 69 3374 37 0 

20 3260 40 0 70 3941 40 0 


(Continued) 
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Case No. Grams Weeks Smoke Case No. Grams Weeks Smoke 
21 2183 42 1 71 2070 37 0 
22 3204 38 0 72 3345 40 0 
23 3005 36 0 73 3600 40 0 
24 3090 40 1 74 3232 41 0 
25 3430 39 0 75 3657 38 1 
26 3119 40 0 76 3487 39 0 
27 3912 39 0 77 2948 38 0 
28 3572 40 0 78 2722 40 0 
29 3884 41 0 79 3771 40 0 
30 3090 38 0 80 3799 45 0 
31 2977 42 0 81 1871 33 0 
32 3799 37 0 82 3260 39 0 
33 4054 40 0 83 3969 38 0 
34 3430 38 1 84 3771 40 0 
35 3459 41 0 85 3600 40 0 
36 3827 39 0 86 2693 35 1 
37 3147 44 1 87 3062 45 0 
38 3289 38 0 88 2693 36 0 
39 3629 36 0 89 3033 41 0 
40 3657 36 0 90 3856 42 0 
41 3175 41 1 91 4111 40 0 
42 3232 43 1 92 3799 39 0 
43 3175 36 0 93 3147 38 0 
44 3657 40 1 94 2920 36 0 
45 3600 39 0 95 4054 40 0 
46 3572 40 0 96 2296 36 0 
47 709 25 0 97 3402 38 0 
48 624 25 0 98 1871 33 1 
49 2778 36 0 99 4167 41 0 
50 3572 35 0 100 3402 37 1 


Source: John P. Holcomb, sampled and coded from North Carolina Birth Registry data found at www.irss.unc. 
edu/ ncvital/ bfd 1down.html. 


Solution: For the analysis, we quantify smoking status by means of a dummy variable 
that is coded 1 if the mother is a smoker and 0 if she is a nonsmoker. The data 
in Table 11.2.1 are plotted as a scatter diagram in Figure 11.2.1. The scatter 
diagram suggests that, in general, longer periods of gestation are associated 
with larger birth weights. 

To obtain additional insight into the nature of these data, we may enter 
them into a computer and employ an appropriate program to perform further 
analyses. For example, we enter the observations у; = 3147, х = 40, x21 = 0, 
for the first case; У» = 2977, x12 = 41, x22 = 0 for the second case; and so on. 
Figure 11.2.2 shows the computer output obtained with the use of the 
MINITAB multiple regression program. 
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nonsmoking mothers. 


The regression equation is 


grams — —1724 + 130 x1 


Predictor Coef 

Constant —1724.4 
weeks (x1) 130.05 
smoke (x2) —294.4 


S = 484.6 


Analysis of Variance 


SOURCE 

R egression 
Residual Error 
Total 


SOURCE 
х1 
х2 


R-Sq = 464% 


55 

19689185 
22781681 
42410867 


Seq SS 
18585166 
1104020 


Birth weights and lengths of gestation for 100 births: (A) smoking and (0) 


T 
—3.09 

8.96 
—2.17 


R-Sq(adj) = 45.3% 


MS 
9844593 
234863 


FIGURE 11.2.2 Partial computer printout, MINITAB multiple regression analysis. 


Example 11.2.1. 
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5000 


4000 


3000 


2000 


Birth weight (grams) 


1000 


We see in the printout that the multiple regression equation is 


У; = Êo + Виху + 


$; = —1724.4 + 130.05x; — 294.45 


(11.2.1) 


To observe the effect on this equation when we wish to consider only 
the births to smoking mothers, we let х2; = 1. The equation then becomes 


у; = —1724.4 + 130.05x1; — 294.4(1) 


= —2018.8 + 130.05; 


(11.2.2) 


which has a y-intercept of —2018.8 and a slope of 130. Note that the y-intercept 
for the new equation is equal to (Ву + 8,) = [- 1724.4 + (—294.4)] = —2018. 
Now let us consider only births to nonsmoking mothers. When we let 


хә = 0, our regression equation reduces to 


ӯ; = —1724.4 + 130.05: — 294(0) 


= —1724.4 + 130.05xj 


(11.2.3) 


The slope of this equation is the same as the slope of the equation for 
smoking mothers, but the y-intercepts are different. The y-intercept for the 
equation associated with nonsmoking mothers is larger than the one for the 
smoking mothers. These results show that for this sample, babies born to 


Smoking 
mothers 


Nonsmoking 
mothers 


Length of gestation (weeks) 


FIGURE 11.2.3 Birth weights and lengths of gestation for 100 births and the fitted regression 
lines: (A) smoking and (€) nonsmoking mothers. 
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mothers who do not smoke weighed, on the average, more than babies born to 
mothers who do smoke, when length of gestation is taken into account. The 
amount of the difference, on the average, is 294 grams. Stated another way, 
we can say that for this sample, babies born to mothers who smoke weighed, 
on the average, 294 grams less than the babies born to mothers who do not 
smoke, when length of gestation is taken into account. Figure 11.2.3 shows 
the scatter diagram of the original data along with a plot of the two regression 
lines (Equations 11.2.2 and 11.2.3). a 


EXAMPLE 11.2.2 


At this point a question arises regarding what inferences we can make about the sampled 
population on the basis of the sample results obtained in Example 11.2.1. First of all, we 
wish to know if the sample difference of 294 grams is significant. In other words, does 
smoking have an effect on birth weight? We may answer this question through the 
following hypothesis testing procedure. 


Solution: 


. Data. The data are as given in Example 11.2.1. 
. Assumptions. We presume that the assumptions underlying multiple 


regression analysis are met. 


. Hypotheses. Но: В» = 0; Ha: 62% 0. Suppose we let а = .05. 
. Test statistic. The test statistic is 1=(8, — 0)/5В». 


. Distribution of test statistic. When the assumptions are met and Но is 


true the test statistic is distributed as Student's г with 97 degrees of 
freedom. 


. Decision rule. We reject Но if the computed 1 is either greater than or 


equal to 1.9848 or less than or equal to —1.9848 (obtained by 
interpolation). 


. Calculation of test statistic. The calculated value of the test statistic 


appears in Figure 11.2.2 as the f ratio for the coefficient associated with 
the variable appearing in Column 4 of Table 11.2.1. This coefficient, of 
course, is 5. We see that the computed t is —2.17. 


. Statistical decision. Since —2.17 « —1.9848, we reject Ho. 
. Conclusion. We conclude that, in the sampled population, whether the 


mothers smoke is associated with a reduction in the birth weights of their 
babies. 


10. p value. For this test we have p = .033 from Figure 11.2.2. ш 


A Confidence Interval for $ Given that we are able to conclude that in the 
sampled population the smoking status of the mothers does have an effect on the birth 
weights of their babies, we may now inquire as to the magnitude of the effect. Our best 
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point estimate of the average difference in birth weights, when length of gestation is taken 
into account, is 294 grams in favor of babies born to mothers who do not smoke. We may 
obtain an interval estimate of the mean amount of the difference by using information from 
the computer printout by means of the following expression: 


By + 158, 
For а 95% confidence interval, we have 


—294.4 + 1.9848(135.8) 
(—563.9, —24.9) 


Thus, we are 9596 confident that the difference is somewhere between about 564 grams and 
25 grams. 


Advantages of Dummy Variables The reader may have correctly surmised 
that an alternative analysis of the data of Example 11.2.1 would consist of fitting two 
separate regression equations: one to the subsample of mothers who smoke and another to 
the subsample of those who do not. Such an approach, however, lacks some of the 
advantages of the dummy variable technique and is a less desirable procedure when the 
latter procedure is valid. If we can justify the assumption that the two separate regression 
lines have the same slope, we can get a better estimate of this common slope through the 
use of dummy variables, which entails pooling the data from the two subsamples. In 
Example 11.2.1 the estimate using a dummy variable is based on a total sample size of 100 
observations, whereas separate estimates would be based on a sample of 85 smokers and 
only 15 nonsmokers. The dummy variables approach also yields more precise inferences 
regarding other parameters since more degrees of freedom are available for the calculation 
of the error mean square. 


Use of Dummy Variables: Interaction Present Now let us consider the 
situation in which interaction between the variables is assumed to be present. Suppose, for 
example, that we have two independent variables: one quantitative variable X; and one 
qualitative variable with three response levels yielding the two dummy variables X5 and Хз. 
The model, then, would be 


yj = Bo  BiXiyj + BoXoj + ВзХз; + ВХ Хэу + BsX Ху + Е; (11.2.4) 


in which ВХ; Хо; and В5 Хи, Хз; are called interaction terms and represent the interaction 
between the quantitative and the qualitative independent variables. Note that there is no 
need to include in the model the term containing Хо Хз;; it will always be zero because 
when X» = 1, Хз = 0, and when Хз = 1, X2 = 0. The model of Equation 11.2.4 allows for 
a different slope and Yintercept for each level of the qualitative variable. 

Suppose we use dummy variable coding to quantify the qualitative variable as follows: 


Y= 1 for level 1 
2 |] 0 otherwise 


Х. — 1 for level 2 
3 — | Ootherwise 
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The three sample regression equations for the three levels of the qualitative variable, 
then, are as follows: 
Level 1 (X2 = LX; = 0) 
У; = Bo thon +0201) +3(0) + Pony) +B5x1;(0) 
= Bo +811; tB. + Вах (11.2.5) 
= (Bo +В») + (i + Ва) хи; 
Level 2 (X2 = 0, X3 = 1) 


y= bo +Йухуу +600) +301) +Ёху(0) + Bsx1j(1) 
= Po + Виху + Вз + В5хи (11.2.6) 
= (Bo +83) + (Bi +Bs) ху 


Level 3 (X2 =0, Хз = 0) 


ў; = Po thon + B,(0) + (0) + Byx1j(0) + B5(0) 
p 


(11.2.7) 
0 TB 


Let us illustrate these results by means of an example. 


EXAMPLE 11.2.3 


A team of mental health researchers wishes to compare three methods (A, B, and C) of 
treating severe depression. They would also like to study the relationship between age 
and treatment effectiveness as well as the interaction (if any) between age and treatment. 
Each member of a simple random sample of 36 patients, comparable with respect to 
diagnosis and severity of depression, was randomly assigned to receive treatment A, B, 
or C. The results are shown in Table 11.2.2. The dependent variable Y is treatment 
effectiveness, the quantitative independent variable X, is patient's age at nearest birthday, 
and the independent variable type of treatment is a qualitative variable that occurs at three 
levels. The following dummy variable coding is used to quantify the qualitative variable: 


X= 1 for treatment A 
2 — A Ootherwise 


cs { 1 for treatment B 


0 otherwise 


The scatter diagram for these data is shown in Figure 11.2.4. Table 11.2.3 shows the 
data as they were entered into a computer for analysis. Figure 11.2.5 contains the printout 
of the analysis using the MINITAB multiple regression program. 


Solution: Now let us examine the printout to see what it provides in the way of insight 
into the nature of the relationships among the variables. The least-squares 
equation is 


M = 6.21 + 1.03xj + 41.3x5j + 22.7хз; = A03x1;xoj = .510хуухзу 
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TABLE 11.2.2 Data for Example 11.2.3 


Measure of Effectiveness Age Method of Treatment 
56 21 A 
41 23 B 
40 30 B 
28 19 C 
55 28 A 
25 23 C 
46 33 B 
71 67 C 
48 42 B 
63 33 A 
52 33 A 
62 56 C 
50 45 C 
45 43 B 
58 38 A 
46 37 C 
58 43 B 
34 27 C 
65 43 A 
55 45 B 
57 48 B 
59 47 C 
64 48 A 
61 53 A 
62 58 B 
36 29 C 
69 53 A 
47 29 B 
73 58 A 
64 66 B 
60 67 B 
62 63 A 
71 59 C 
62 51 C 
70 67 A 
71 63 C 


The three regression equations for the three treatments are as follows: 


Treatment A (Equation 11.2.5) 


у; = (6.21 + 41.3) + (1.03 — .703)xij 
= 47.51 + .327х1; 
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Treatment effectiveness 
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Age 
FIGURE 11.2.4 Scatter diagram of data for Example 11.2.3: (0) treatment A, (A) treatment B, 
(Ш) treatment С. 


| | 
5 70 75 80 


Treatment B (Equation 11.2.6) 


ў = (6.21 + 22.7) + (1.03 — .510)xij 
= 28.91 + .520х1; 


Treatment C (Equation 11.2.7) 
5; = 6.21 + 1.03х1; 


Figure 11.2.6 contains the scatter diagram of the original data 
along with the regression lines for the three treatments. Visual inspection 
of Figure 11.2.6 suggests that treatments A and B do not differ greatly with 
respect to their slopes, but their y-intercepts are considerably different. The 
graph suggests that treatment A is better than treatment B for younger 
patients, but the difference is less dramatic with older patients. Treatment C 
appears to be decidedly less desirable than both treatments A and B for 
younger patients but is about as effective as treatment B for older patients. 
These subjective impressions are compatible with the contention that there is 
interaction between treatments and age. 


Inference Procedures 


The relationships we see in Figure 11.2.6, however, are sample results. What can we 
conclude about the population from which the sample was drawn? 

For an answer let us look at the ¢ ratios on the computer printout in Figure 11.2.5. 
Each of these is the test statistic 
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TABLE 11.2.3 Data for Example 11.2.3 Coded for Computer Analysis 


Y X X, Xs Х.Х, X Xs 
56 21 1 0 21 0 
55 28 1 0 28 0 
63 33 1 0 33 0 
52 33 1 0 33 0 
58 38 1 0 38 0 
65 43 1 0 43 0 
64 48 1 0 48 0 
61 53 1 0 53 0 
69 53 1 0 53 0 
73 58 1 0 58 0 
62 63 1 0 63 0 
70 67 1 0 67 0 
41 23 0 1 0 23 
40 30 0 1 0 30 
46 33 0 1 0 33 
48 42 0 1 0 42 
45 43 0 1 0 43 
58 43 0 1 0 43 
55 45 0 1 0 45 
57 48 0 1 0 48 
62 58 0 1 0 58 
47 29 0 1 0 29 
64 66 0 1 0 66 
60 67 0 1 0 67 
28 19 0 0 0 0 
25 23 0 0 0 0 
71 67 0 0 0 0 
62 56 0 0 0 0 
50 45 0 0 0 0 
46 37 0 0 0 0 
34 27 0 0 0 0 
59 47 0 0 0 0 
36 29 0 0 0 0 
71 59 0 0 0 0 
62 51 0 0 0 0 
71 63 0 0 0 0 


for testing Ho: B; = 0. We see by Equation 11.2.5 that the y-intercept of the regression line for 
treatment A is equal to Bo +. Since the г ratio of 8.12 for testing Но: В = 0 is greater than 
the critical t of 2.0423 (for a = .05), we can reject Но that 5 = 0 and conclude that the y- 
intercept of the population regression line for treatment A is different from the y-intercept of 
the population regression line for treatment C, which has a y-intercept of Во. Similarly, 
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The regression equation is 
у = 6.21 + 1.03х1 + 41.3x2 + 227 x3 — 0.703х4 - 0.510 x5 


Predictor Coef Stdev t-ratio 
Constant 6.211 3.350 1.85 
x1 1.03339 0.07233 14.29 
x2 41.304 5.085 8.12 
x3 22.707 5.091 4.46 
x4 —0.7029 0.1090 —6.45 
x5 —0.5097 0.1104 —4.62 


5 = 3.925 R-sq — 91.496 R-sq(adj) — 90.096 


Analysis of Variance 


SOURCE DF SS MS F p 
Regression 4932.85 986.57 64.04 0.000 
Error 462.15 15.40 

Total 5395.00 


SOURCE SEQ SS 
x1 3424.43 
x2 803.80 
x3 1.19 
x4 375.00 
x5 328.42 
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70 pa А Тгеаїтепї А 


Treatment B 


Treatment effectiveness 


| | | І І І І І І І І 
5 30 35 40 45 50 55 60 65 70 75 80 
Аде 
FIGURE 11.2.6 Scatter diagram of data for Example 11.2.3 with the fitted regression lines: (6) 
treatment A, (A) treatment B, (№) treatment C. 
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since the t ratio of 4.46 for testing Ho: Вз = 0 is also greater than the critical t of 2.0423, we can 
conclude (at the .05 level of significance) that the y-intercept of the population regression line 
for treatment B is also different from the y-intercept of the population regression line for 
treatment C. (See the y-intercept of Equation 11.2.6.) 

Now let us consider the slopes. We see by Equation 11.2.5 that the slope of the 
regression line for treatment A is equal to В, (the slope of the line for treatment С) tf. 
Since the ¢ ratio of —6.45 for testing Но: Вл = 0 is less than the critical t of —2.0423, we can 
conclude (for о = .05) that the slopes of the population regression lines for treatments A 
and C are different. Similarly, since the computed 7 ratio for testing Ho: 85 = 0 is also less 
than —2.0423, we conclude (for a = .05) that the population regression lines for treatments 
B and C have different slopes (see the slope of Equation 11.2.6). Thus, we conclude that 
there is interaction between age and type of treatment. This is reflected by a lack of 
parallelism among the regression lines in Figure 11.2.6. и 


Another question of interest is this: Is the slope of the population regression line for 
treatment A different from the slope of the population regression line for treatment B? To 
answer this question requires computational techniques beyond the scope of this text. The 
interested reader is referred to books devoted specifically to regression analysis. 

In Section 10.4 the reader was warned that there are problems involved in making 
multiple inferences from the same sample data. Again, books on regression analysis are 
available that may be consulted for procedures to be followed when multiple inferences, 
such as those discussed in this section, are desired. 

We have discussed only two situations in which the use of dummy variables is 
appropriate. More complex models involving the use of one or more qualitative indepen- 
dent variables in the presence of two or more quantitative variables may be appropriate in 
certain circumstances. More complex models are discussed in the many books devoted to 
the subject of multiple regression analysis. 

Atthis point it may be evident that there are many similarities between the use ої а linear 
regression model using dummy variables and the basic ANOVA approach. In both cases, one is 
attempting to model the relationship between predictor variables and an outcome variable. 
In the case of linear regression, we are generally most interested in prediction, and in ANOVA, 
we are generally most interested in comparing means. If the desire is to compare means 
using regression, one could develop a model to predict mean response, say ui, instead of an 
outcome, y;. Modeling the mean response using regression with dummy variables is equivalent 
to ANOVA. For the interested student, we suggest the book by Bowerman and O'Connell (1), 
who provide an example of using both approaches for the same data. 


EXERCISES 


For each exercise do the following: 


(a) Draw a scatter diagram of the data using different symbols for the different categorical variables. 
(b) Use dummy variable coding and regression to analyze the data. 


(c) Perform appropriate hypothesis tests and construct appropriate confidence intervals using your 
choice of significance and confidence levels. 


(d) Find the p value for each test that you perform. 


11.2.1 


11.2.2 
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For subjects undergoing stem cell transplants, dendritic cells (DCs) are antigen-presenting cells that 
are critical to the generation of immunologic tumor responses. Bolwell et al. (A-2) studied lymphoid 
DCs in 44 subjects who underwent autologous stem cell transplantation. The outcome variable is the 
concentration of DC2 cells as measured by flow cytometry. One of the independent variables is the 
age of the subject (years), and the second independent variable is the mobilization method. During 
chemotherapy, 11 subjects received granulocyte colony-stimulating factor (G-CSF) mobilizer 
(ug/kg/day) and 33 received etoposide (2 g/m?). The mobilizer is a kind of blood progenitor 
cell that triggers the formation of the DC cells. The results were as follows: 


G-CSF Etoposide 

DC Age DC Age DC Age DC Age 
6.16 65 3.18 70 4.24 60 4.09 36 
6.14 55 2.58 64 4.86 40 2.86 51 
5.66 57 1.69 65 4.05 48 2:25 54 
8.28 47 2.16 55 5.07 50 0.70 50 
2.99 66 3.26 51 4.26 23 0.23 62 
8.99 24 1.61 53 11.95 26 1.31 56 
4.04 59 6.34 24 1.88 59 1.06 31 
6.02 60 2.43 53 6.10 24 3.14 48 

10.14 66 2.86 37 0.64 52 1.87 69 

27.25 63 7.74 65 2.21 54 8.21 62 
8.86 69 11.33 19 6.26 43 1.44 60 


Source: Data provided courtesy of Lisa Rybicki, M.S. 


According to Pandey et al. (A-3) carcinoma of the gallbladder is not infrequent. One of the primary 
risk factors for gallbladder cancer is cholelithiasis, the asymptomatic presence of stones in the 
gallbladder. The researchers performed a case-control study of 50 subjects with gallbladder cancer 
and 50 subjects with cholelithiasis. Of interest was the concentration of lipid peroxidation products in 
gallbladder bile, a condition that may give rise to gallbladder cancer. The lipid peroxidation product 
melonaldehyde (MDA, mg/mg) was used to measure lipid peroxidation. One of the independent 
variables considered was Ше cytochrome P-450 concentration (CY TO, nmol/mg). Researchers used 
disease status (gallbladder cancer vs. cholelithiasis) and cytochrome P-450 concentration to predict 
MDA. The following data were collected. 


Cholelithiasis Gallbladder Cancer 
MDA CYTO MDA CYTO MDA CYTO MDA CYTO 
0.68 12.60 11.62 4.83 1.60 22.74 9.20 8.99 
0.16 4.72 2.71 3.25 4.00 4.63 0.69 5.86 
0.34 3.08 3.39 7.03 4.50 9.83 10.20 28.32 
3.86 5.23 6.10 9.64 0.77 8.03 3.80 4.76 
0.98 4.29 1.95 9.02 2.79 9.11 1.90 8.09 
3.31 21.46 3.80 7.76 8.78 7.50 2.00 21.05 
1.11 10.07 1.72 3.68 2.69 18.05 7.80 20.22 
4.46 5.03 9.31 11.56 0.80 3.92 16.10 9.06 
1.16 11.60 3.25 10.33 3.43 22.20 0.98 35.07 


(Continued ) 
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11.2.3 


Cholelithiasis Gallbladder Cancer 


MDA CYTO MDA CYTO MDA CYTO MDA CYTO 


1.27 9.00 0.62 2.72. 2.73 11.68 2.85 29.50 
1.38 6.13 2.46 4.01 1.41 19.10 3.50 45.06 
3.83 6.06 7.63 6.09 6.08 36.70 4.80 8.99 
0.16 6.45 4.60 4.53 5.44 48.30 1.89 48.15 
0.56 4.78 12.21 19.01 4.25 4.47 2.90 10.12 
1.95 34.76 1.03 9.62 1.76 8.83 0.87 17.98 
0.08 15.53 1.25 7.59 8.39 5.49 4.25 37.18 
2.17 12.23 2.13 12.33 2.82 3.48 1.43 19.09 
0.00 0.93 0.98 5.26 5.03 7.98 6.75 6.05 
1.35 3.81 1.53 5.69 7.30 27.04 4.30 17.05 
3.22 6.39 3.91 7.72 4.97 16.02 0.59 7.19 
1.69 14.15 2.25 7.61 1.11 6.14 5.30 6.78 
4.90 5.67 1.67 4.32 13.27 13.31 1.80 16.03 
1.33 8.49 5.23 17.79 7.73 10.03 3.50 5.07 
0.64 2.27 2.79 15.51 3.69 17.23 4.98 16.60 
5.21 12.35 1.43 12.43 9.26 9.29 6.98 19.89 


Source: Data provided courtesy of Manoj Pandey, M.D. 


The purpose of a study by Krantz et al. (A-4) was to investigate dose-related effects of methadone 
in subjects with torsades de pointes, a polymorphic ventricular tachycardia. In the study of 
17 subjects, 10 were men (sex — 0) and seven were women (sex — 1). The outcome variable, is 
the QTc interval, a measure of arrhythmia risk. The other independent variable, in addition to sex, 
was methadone dose (mg/day). Measurements on these variables for the 17 subjects were as 
follows. 


Sex Dose (mg/day) QTc (msec) 
0 1000 600 
0 550 625 
0 97 560 
1 90 585 
1 85 590 
1 126 500 
0 300 700 
0 110 570 
1 65 540 
1 650 785 
1 600 765 
1 660 611 
1 270 600 
1 680 625 
0 540 650 
0 600 635 
1 330 522 


Source: Data provided courtesy of Mori J. Krantz, M.D. 
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11.2.4 Refer to Exercise 9.7.2, which describes research by Reiss et al. (А-5), who collected samples from 
90 patients and measured partial thromboplastin time (aPTT) using two different methods: the 
CoaguChek point-of-care assay and standard laboratory hospital assay. The subjects were also 
classified by their medication status: 30 receiving heparin alone, 30 receiving heparin with warfarin, 
and 30 receiving warfarin and enoxaparin. The data are as follows. 


Heparin Heparin and Warfarin Warfarin and Enoxaparin 
CoaguChek Hospital CoaguChek Hospital CoaguChek Hospital 
aPTT aPTT aPTT aPTT aPTT aPTT 

49.3 71.4 18.0 77.0 56.5 46.5 
57.9 86.4 31.2 62.2 50.7 34.9 
59.0 75.6 58.7 53.2 37.3 28.0 
77.3 54.5 75.2 53.0 64.8 52.3 
42.3 57.7 18.0 45.7 41.2 37.5 
44.3 59.5 82.6 81.1 90.1 47.1 
90.0 77.2 29.6 40.9 23.1 27.1 
55.4 63.3 82.9 75.4 532 40.6 
20.3 27.6 58.7 55.7 27.3 37.8 
28.7 52.6 64.8 54.0 67.5 50.4 
64.3 101.6 37.9 79.4 33.6 34.2 
90.4 89.4 81.2 62.5 45.1 34.8 
64.3 66.2 18.0 36.5 56.2 44.2 
89.8 69.8 38.8 32.8 26.0 28.2 
74.7 91.3 95.4 68.9 67.8 46.3 
150.0 118.8 53.7 71.3 40.7 41.0 
32.4 30.9 128.3 111.1 362 35.7 
20.9 652 60.5 80.5 60.8 47.2 
89.5 77.9 150.0 150.0 30.2 39.7 
44.7 91.5 38.5 46.5 18.0 31.3 
61.0 90.5 58.9 89.1 55.6 53.0 
36.4 33.6 112.8 66.7 18.0 27.4 
52.9 88.0 26.7 29.5 18.0 35.7 
57.5 69.9 49.7 47.8 78.3 62.0 
39.1 41.0 85.6 63.3 75.3 36.7 
74.8 81.7 68.8 43.5 73.2 85.3 
32.5 33.3 18.0 54.0 42.0 38.3 
125.7 142.9 92.6 100.5 49.3 39.8 
77.1 98.2 46.2 52.4 22.8 42.3 
143.8 108.3 60.5 93.7 35.8 36.0 


Source: Data provided courtesy of Curtis E. Haas, Pharm.D. 


Use the multiple regression to predict the hospital aPTT from the CoaguCheck aPTT level as well as 
the medication received. Is knowledge of medication useful in the prediction? Let œ = .05 for all 
tests. 
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11.3 VARIABLE SELECTION PROCEDURES 


Health sciences researchers contemplating the use of multiple regression analysis to 
investigate a question usually find that they have a large number of variables from which to 
select the independent variables to be employed as predictors of the dependent variable. 
Such investigators will want to include in their model as many variables as possible in order 
to maximize the model’s predictive ability. The investigator must realize, however, that 
adding another independent variable to a set of independent variables always increases the 
coefficient of determination R?. Therefore, independent variables should not be added to 
the model indiscriminately, but only for good reason. In most situations, for example, some 
potential predictor variables are more expensive than others in terms of data-collection 
costs. The cost-conscious investigator, therefore, will not want to include an expensive 
variable in a model unless there is evidence that it makes a worthwhile contribution to the 
predictive ability of the model. 

The investigator who wishes to use multiple regression analysis most effectively 
must be able to employ some strategy for making intelligent selections from among those 
potential predictor variables that are available. Many such strategies are in current use, and 
each has its proponents. The strategies vary in terms of complexity and the tedium involved 
in their employment. Unfortunately, the strategies do not always lead to the same solution 
when applied to the same problem. 


Stepwise Regression Perhaps the most widely used strategy for selecting inde- 
pendent variables for a multiple regression model is the stepwise procedure. The procedure 
consists of a series of steps. At each step of the procedure each variable then in the model is 
evaluated to see if, according to specified criteria, it should remain in the model. 

Suppose, for example, that we wish to perform stepwise regression for a model 
containing k predictor variables. The criterion measure is computed for each variable. 
Of all the variables that do not satisfy the criterion for inclusion in the model, the one that 
least satisfies the criterion is removed from the model. If a variable is removed in this step, 
the regression equation for the smaller model is calculated and the criterion measure is 
computed for each variable now in the model. If any of these variables fail to satisfy the 
criterion for inclusion in the model, the one that least satisfies the criterion is removed. If a 
variable is removed at this step, the variable that was removed in the first step is reentered 
into the model, and the evaluation procedure is continued. This process continues until no 
more variables can be entered or removed. 

The nature of the stepwise procedure is such that, although a variable may be deleted 
from the model in one step, it is evaluated for possible reentry into the model in subsequent 
steps. 

MINITAB's STEPWISE procedure, for example, uses the associated F statistic as 
the evaluative criterion for deciding whether a variable should be deleted or added to 
the model. Unless otherwise specified, the cutoff value is F — 4. The printout of the 
STEPWISE results contains 1 statistics (the square root of F) rather than F statistics. At 
each step MINITAB calculates an F statistic for each variable then in the model. If the F 
statistic for any of these variables is less than the specified cutoff value (4 if some other 
value is not specified), the variable with the smallest F is removed from the model. The 
regression equation is refitted for the reduced model, the results are printed, and the 
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procedure goes to the next step. If no variable can be removed, the procedure tries to add a 
variable. An F statistic is calculated for each variable not then in the model. Of these 
variables, the one with the largest associated F statistic is added, provided its F statistic is 
larger than the specified cutoff value (4 if some other value is not specified). The regression 
equation is refitted for the new model, the results are printed, and the procedure goes on to 
the next step. The procedure stops when no variable can be added or deleted. 

The following example illustrates the use of the stepwise procedure for selecting 
variables for a multiple regression model. 


EXAMPLE. 11.3.1 


A nursing director would like to use nurses' personal characteristics to develop a regression 
model for predicting the job performance (JOBPER). The following variables are available 
from which to choose the independent variables to include in the model: 


X, = assertiveness (ASRV) 

X; = enthusiasm (ENTH) 

Хз = ambition (AMB) 

X4 — communication skills (COMM) 
Xs — problem-solving skills (PROB) 
X6 = initiative (INIT) 


We wish to use the stepwise procedure for selecting independent variables from those 
available in the table to construct a multiple regression model for predicting job 
performance. 


Solution: Table 11.3.1 shows the measurements taken on the dependent variable, 
JOBPER, and each of the six independent variables for a sample of 
30 nurses. 


TABLE 11.3.1 Measurements on Seven Variables 
for Examples 11.3.1 


Y x X2 X3 Xa Xs Xe 
45 74 29 40 66 93 47 
65 65 50 64 68 74 49 
73 71 67 79 81 87 33 
63 64 44 57 59 85 37 
83 79 55 76 76 84 33 
45 56 48 54 59 50 42 
60 68 41 66 71 69 37 
73 76 49 65 75 67 43 
74 83 71 77 76 84 33 
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Y x X2 Xs Ха Xs Xe 
69 62 44 57 67 81 43 
66 54 52 67 63 68 36 
69 61 46 66 84 75 43 
71 63 56 67 60 64 35 
70 84 82 68 84 78 37 
79 78 53 82 84 78 39 
83 65 49 82 65 55 38 
75 86 63 79 84 80 41 
67 61 64 75 60 81 45 
67 71 45 67 80 86 48 
52 59 67 64 69 79 54 
52 71 32 44 48 65 43 
66 62 51 72 71 81 43 
55 67 51 60 68 81 39 
42 65 41 45 55 58 51 
65 55 41 58 71 76 35 
68 78 65 73 93 77 42 
80 76 57 84 85 79 35 
50 58 43 55 56 84 40 
87 86 70 81 82 75 30 
84 83 38 83 69 79 41 


We use MINITAB to obtain a useful model by the stepwise procedure. 
Observations on the dependent variable job performance (JOBPER) and the 
six candidate independent variables are stored in MINITAB Columns 1 
through 7, respectively. Figure 11.3.1 shows the appropriate MINITAB 
procedure and the printout of the results. 

To obtain the results in Figure 11.3.1, the values of F to enter and F to 
remove both were set automatically at 4. In step 1 there are no variables to be 
considered for deletion from the model. The variable AMB (Column 4) has 
the largest associated F statistic, which is Е= (9.74)? = 94.8676. Since 
94.8676 is greater than 4, AMB is added to the model. In step 2 the variable 
INIT (Column 7) qualifies for addition to the model since its associated F of 
(—2.2)? = 4.84 is greater than 4 and it is the variable with the largest 
associated F statistic. It is added to the model. After step 2 no other variable 
could be added or deleted, and the procedure stopped. We see, then, that the 
model chosen by the stepwise procedure is a two-independent-variable model 
with AMB and INIT as the independent variables. The estimated regression 
equation is 


$ = 31.96 + .787хз — A5xg = 
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Dialog box: Session command: 


Stat » Regression » Stepwise МТВ > Stepwise Cl C2-C7; 
SUBC> FEnter 4.0; 
Type C/ in Response and C2-C7 in Predictors. SUBC»  FRemove 4.0. 


Stepwise Regression 


F-to-Enter: 4.00 F-to-Remove: 4.00 


Response 


Step 
Constant 


C4 
T-Ratio 


ey 


FIGURE 11.3.1 


is Cl on 6 predictors, with N=30 


1 2 
7.226 314955 


0.888 .787 
9.74 .13 


.45 
.20 


203 
. 68 


MINITAB stepwise procedure and output for the data of Table 11.3.1. 


To change the criterion for allowing a variable to enter the model from 4 to some 
other value K, click on Options, then type the desired value of K in the Enter box. The new 
criterion F statistic, then, is K rather than 4. To change the criterion for deleting a variable 
from the model from 4 to some other value K, click on Options, then type the desired value 
of K in the Remove box. We must choose K to enter to be greater than or equal to K to 
remove. 

Though the stepwise selection procedure is à common technique employed by 
researchers, other methods are available. Following is a brief discussion of two such tools. 
The final model obtained by each of these procedures is the same model that was found by 
using the stepwise procedure in Example 11.3.1. 


Forward Selection This strategy is closely related to the stepwise regression 
procedure. This method builds a model using correlations. Variables are retained that meet 
the criteria for inclusion, as in stepwise selection. The first variable entered into the model 
is the one with the highest correlation with the dependent variable. If this variable meets the 
inclusion criterion, it is retained. The next variable to be considered for inclusion is the one 
with the highest partial correlation with the dependent variable. If it meets the inclusion 
criteria, it is retained. This procedure continues until all of the independent variables have 
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been considered. The final model contains all of the independent variables that meet the 
inclusion criteria. 


Backward Elimination This model-building procedure begins with all of the 
variables in the model. This strategy also builds a model using correlations and a 
predetermined inclusion criterion based on the F statistic. The first variable considered 
for removal from the model is the one with the smallest partial correlation coefficient. If 
this variable does not meet the criterion for inclusion, it is eliminated from the model. The 
next variable to be considered for elimination is the one with the next lowest partial 
correlation. It will be eliminated if it fails to meet the criterion for inclusion. This procedure 
continues until all variables have been considered for elimination. The final model contains 
all of the independent variables that meet the inclusion criteria. 


EXERCISES 


11.3.1 Refer to the data of Exercise 10.3.2 reported by Son et al. (A-6), who studied family caregiving in 
Korea of older adults with dementia. The outcome variable, caregiver burden (BURDEN), was 
measured by the Korean Burden Inventory (KBI) where scores ranged from 28 to 140 with higher 
scores indicating higher burden. Perform a stepwise regression analysis on the following independent 
variables reported by the researchers: 


CGAGE: caregiver age (years) 
CGINCOME: caregiver income (Won-Korean currency) 
СОРОК: caregiver-duration of caregiving (month) 


ADL: total activities of daily living where low scores indicate the elderly perform activities 
independently. 


MEM: memory and behavioral problems with higher scores indicating more problems. 
COG: cognitive impairment with lower scores indicating a greater degree of cognitive impairment. 


SOCIALSU: total score of perceived social support (25-175, higher values indicating more 
support). The reported data are as follows. 


ССАСЕ  ССІХСОМЕ CGDUR ADL MEM СОС  SOCIALSU BURDEN 


41 200 12 39 4 18 119 28 
30 120 36 52 33 9 131 68 
41 300 60 89 17 3 141 59 
35 350 2 57 31 7 150 91 
37 600 48 28 35 19 142 70 
42 90 4 34 3 25 148 38 
49 300 26 42 16 17 172 46 
39 500 16 52 6 26 147 57 
49 309 30 88 41 13 98 89 
40 250 60 90 24 3 147 48 
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ССАСЕ CGINCOME CGDUR ADL МЕМ СОС 


SOCIALSU BURDEN 


40 
70 
49 
55 
27 
39 
39 
44 
33 
42 
52 
48 
53 
40 
35 
47 
33 
41 
43 
25 
35 
35 
45 
36 
52 
41 
40 
45 
48 
50 
31 
33 
30 
36 
45 
32 
55 
50 
37 
40 
40 
49 
37 
47 
41 
33 
28 


300 
60 
450 
300 
309 
250 
260 
250 
200 
200 
200 
300 
300 
300 
200 
150 
180 
200 
300 
309 
250 
200 
200 
300 
600 
230 
200 
400 
75 
200 
250 
300 
200 
250 
500 
300 
200 
309 
250 
1000 
300 
300 
309 
250 
200 
1000 
309 


36 
10 
24 
18 
30 
10 
12 
32 
48 
12 
24 
36 
12 
11 

8 
60 
19 
48 


38 
83 
30 
45 
47 
90 
63 
34 
76 
26 
68 
85 
22 
82 
80 
80 
81 
30 
27 
72 
46 
63 
45 
71 
42 
60 
33 
49 
89 
72 
45 
13 
58 
33 
34 
90 
48 
47 
32 
63 
76 
79 
48 
90 
55 
83 
50 


22 
41 

9 
33 
36 
17 
14 
35 
33 
13 
34 
28 
12 
57 
51 


13 
11 
24 
14 
18 

0 
16 
22 
23 
18 
26 
10 
16 


146 

97 
139 
127 
132 
142 
131 
141 
106 
144 
119 
122 
110 
121 
142 
101 
117 
129 
142 
137 
148 
135 
144 
128 
148 
141 
151 
124 
105 
117 
111 
146 

99 
115 
119 
134 
165 
101 
148 
132 
120 
129 
133 
121 
117 
140 
117 


74 
78 
43 
76 
72 
61 
63 
71 
85 
31 
79 
92 
76 
91 
78 
103 
99 
73 
88 
64 
52 
71 
41 
85 
52 
68 
57 
84 
91 
83 
73 
57 
69 
81 
71 
91 
48 
94 
57 
49 
88 
54 
73 
87 
47 
60 
65 
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CGAGE CGINCOME CGDUR ADL MEM СОС  SOCIALSU BURDEN 


33 400 120 44 31 18 138 57 
34 330 18 79 30 20 163 85 
40 200 18 24 5 22 157 28 
54 200 12 40 20 17 143 40 
32 300 32 35 15 27 125 87 
44 280 66 55 9 21 161 80 
44 350 40 45 28 17 142 49 
42 280 24 46 19 17 135 57 
44 500 14 37 4 21 137 32 
25 600 24 47 29 3 133 52 
41 250 84 28 23 21 131 42 
28 1000 30 61 8 7 144 49 
24 200 12 35 31 26 136 63 
65 450 120 68 65 6 169 89 
50 200 12 80 29 10 127 67 
40 309 12 43 8 13 110 43 
47 1000 12 53 14 18 120 47 
44 300 24 60 30 16 115 70 
37 309 54 63 22 18 101 99 
36 300 12 28 9 27 139 53 
55 200 12 35 18 14 153 78 
45 2000 12 37 33 17 111 112 
45 400 14 82 25 13 131 52 
23 200 36 88 16 0 139 68 
42 1000 12 52 15 0 132 63 
38 200 36 30 16 18 147 49 
41 230 36 69 49 12 171 42 
25 200 30 52 17 20 145 56 
47 200 12 59 38 17 140 46 
35 100 12 53 22 21 139 72 
59 150 60 65 56 2 133 95 
49 300 60 90 12 0 145 57 
51 200 48 88 42 6 122 88 
54 250 6 66 12 23 133 81 
53 30 24 60 21 7 107 104 
49 100 36 48 14 13 118 88 
44 300 48 82 41 13 95 115 
36 200 18 88 24 14 100 66 
64 200 48 63 49 5 125 92 
51 120 2 79 34 3 116 97 
43 200 66 71 38 17 124 69 
54 150 96 66 48 13 132 112 
29 309 19 81 66 1 152 88 


Source: Data provided courtesy of Gwi-Ryung Son, R.N., Ph.D. 
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11.3.2. Machiel Naeije (A-7) identifies variables useful in predicting maximum mouth opening (MMO, 
millimeters) for 35 healthy volunteers. The variables examined were: 


AGE: 


DOWN CON: 


FORW CON: 
Gender: 

MAN. LENG: 
MAN. WIDT: 


years 
downward condylar translation, mm 
forward condylar translation, mm 

0 = Female, 1 = Male 

mandibular length, mm 

mandibular width, mm 


Use the following reported measurements to perform a stepwise regression. 


AGE DOWN CON FORW CON GENDER MAN LENG MAN WIDT MMO 


21.00 4.39 14.18 1 100.86 121.00 52.34 
26.00 1.39 20.23 0 93.08 118.29 51.90 
30.00 2.42 13.45 1 98.43 130.56 52.80 
28.00 —.18 19.66 1 102.95 125.34 50.29 
21.00 4.10 22.71 1 108.24 125.19 57.79 
20.00 4.49 13.94 0 98.34 113.84 49.41 
21.00 2.07 19.35 0 95.57 115.41 53.28 
19.00 —.77 25.65 1 98.86 118.30 59.71 
24.00 7.88 18.51 1 98.32 119.20 53.32 
18.00 6.06 21.72 0 92.70 111.21 48.53 
22.00 9.37 23.21 0 88.89 119.07 51.59 
21.00 3.17 23.02 1 104.06 127.34 58.52 
20.00 1.10 19.59 0 98.18 111.24 62.93 
22.00 2:52 16.64 0 91.01 113.81 57.62 
24.00 5.99 17.38 1 96.98 114.94 65.64 
22.00 5.28 22.57 0 97.86 111.58 52.85 
22.00 1.25 20.89 0 96.89 115.16 64.43 
22.00 6.02 20.38 1 98.35 122.52 57:23 
19.00 1.59 21.63 0 90.65 118.71 50.82 
26.00 6.05 10.59 0 92.99 119.10 40.48 
22.00 —1.51 20.03 1 108.97 129.00 59.68 
24.00 —.41 24.55 0 91.85 100.77 54.35 
21.00 6.75 14.67 1 104.30 127.15 47.00 
22.00 4.87 17.91 1 93.16 123.10 47.23 
22.00 .64 17.60 1 94.18 113.86 41.19 
29.00 7.18 15.19 0 89.56 110.56 42.76 
25.00 6.57 17.25 1 105.85 140.03 51.88 
20.00 1.51 18.01 0 89.29 121.70 42.77 
27.00 4.64 19.36 0 92.58 128.01 52.34 
26.00 3.58 16.57 1 98.64 129.00 50.45 
23.00 6.64 12.47 0 83.70 130.98 43.18 
25.00 7.61 18.52 0 88.46 124.97 41.99 
22.00 5.39 11.66 1 94.93 129.99 39.45 
31.00 5.47 12.85 1 96.81 132.97 38.91 
23.00 2.60 19.29 0 93.13 121.03 49.10 
Source: Data provided courtesy of Machiel Naeije, D.D.S. 
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11.3.3 One purpose of a study by Connor et al. (A-8) was to examine reactive aggression among 


children and adolescents referred to a residential treatment center. The researchers used the 
Proactive/Reactive Rating Scale, obtained by presenting three statements to clinicians who 
examined the subjects. The respondents answered, using a scale from 1 to 5, with 5 indicating 
that the statement almost always applied to the child. An example of a reactive aggression 
statement is, ^When this child has been teased or threatened, he or she gets angry easily and strikes 
back." The reactive score was the average response to three statements of this type. With this 
variable as the outcome variable, researchers also examined the following: AGE (years), 
VERBALIQ (verbal IQ), STIM (stimulant use), AGEABUSE (age when first abused), CTQ 
(a measure of hyperactivity in which higher scores indicate higher hyperactivity), TOTALHOS 
(total hostility as measured by an evaluator, with higher numbers indicating higher hostility). 
Perform stepwise regression to find the variables most useful in predicting reactive aggression in 
the following sample of 68 subjects. 


REACTIVE AGE VERBALIQ STIM AGEABUSE CTQ TOTALHOS 


4.0 17 91 0 0 0 8 
3.7 12 94 0 1 29 10 
2.3 14 105 0 1 12 10 
5.0 16 97 0 1 9 11 
2.0 15 97 0 2 17 10 
2.7 8 91 0 0 6 4 
2.0 10 111 0 0 6 6 
3.3 12 105 0 0 28 7 
2.0 17 101 1 0 12 9 
4.3 13 102 1 1 8 11 
4.7 15 83 0 0 9 9 
4.3 15 66 0 1 5 8 
2.0 15 90 0 2 3 8 
4.0 13 88 0 1 28 8 
2.7 13 98 0 1 17 10 
2:7 9 135 0 0 30 11 
2.7, 18 72 0 0 10 9 
2.0 13 93 0 2 20 8 
3.0 14 94 0 2 10 11 
2 13 93 0 1 4 8 
3.7 16 73 0 0 11 11 
2.7 12 74 0 1 10 7 
2.3 14 97 0 2 3 11 
4.0 13 91 1 1 21 11 
4.0 12 88 0 1 14 9 
4.3 13 90 0 0 15 2 
3.7 14 104 1 1 10 10 
3.0 18 82 0 0 1 7 
4.3 14 79 1 3 6 7 
1.0 16 93 0 0 5 8 
4.3 16 99 0 1 21 11 


(Continued) 
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REACTIVE AGE VERBALIQ STIM AGEABUSE CTQ TOTALHOS 


2:3 14 73 0 2 8 9 
3.0 12 112 0 0 15 9 
1.3 15 102 0 1 1 5 
3.0 16 78 1 1 26 8 
2.3 9 95 1 0 23 10 
1.0 15 124 0 3 0 11 
3.0 17 73 0 1 1 10 
3.3 11 105 0 0 23 5 
4.0 11 89 0 0 27 8 
1.7 9 88 0 1 2 8 
2.3 16 96 0 1 5 7 
4.7 15 76 1 1 17 9 
1.7 16 87 0 2 0 4 
1.7 15 90 0 1 10 12 
4.0 12 76 0 0 22 10 
5.0 12 83 1 1 19 7 
4.3 10 88 1 0 10 5 
5.0 9 98 1 0 8 9 
3.7 12 100 0 0 6 4 
3:3 14 80 0 1 3 10 
2.3 16 84 0 1 3 9 
1.0 17 117 0 2 1 9 
1.7 12 145 1 0 0 5 
3.7 12 123 0 0 1 3 
2.0 16 94 0 2 6 6 
3.7 17 70 0 1 11 13 
4.3 14 113 0 0 8 8 
2.0 12 123 1 0 2 8 
3.0 7 107 0 0 11 9 
3.7 12 78 1 0 15 11 
4.3 14 73 0 1 2 8 
2.3 18 91 0 3 8 10 
4.7 12 91 0 0 6 9 
3.7 15 111 0 0 2 9 
1.3 15 71 0 1 20 10 
3.7 7 102 0 0 14 9 
1.7 9 89 0 0 24 6 


Source: Data provided courtesy of Daniel F. Connor, M.D. and Lang Lin. 


11.4 LOGISTIC REGRESSION 


Up to now our discussion of regression analysis has been limited to those situations in 
which the dependent variable is a continuous variable such as weight, blood pressure, 
or plasma levels of some hormone. Much research in the health sciences field is 
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motivated by a desire to describe, understand, and make use of the relationship 
between independent variables and a dependent (or outcome) variable that is discrete. 
Particularly plentiful are circumstances in which the outcome variable is dichotomous. 
A dichotomous variable, we recall, is a variable that can assume only one of two 
mutually exclusive values. These values are usually coded Y — 1 for a success and Y — 0 
for a nonsuccess, or failure. Dichotomous variables include those whose two possible 
values are such categories as died-did not die; cured-not cured; disease occurred— 
disease did not occur; and smoker-nonsmoker. The health sciences professional who 
either engages in research or needs to understand the results of research conducted by 
others will find it advantageous to have, at least, a basic understanding of logistic 
regression, the type of regression analysis that is usually employed when the dependent 
variable is dichotomous. The purpose of the present discussion is to provide the 
reader with this level of understanding. We shall limit our presentation to the case in 
which there is only one independent variable that may be either continuous or 
dichotomous. 


The Logistic Regression Model Recall that in Chapter 9 we referred to 
regression analysis involving only two variables as simple linear regression analysis. The 
simple linear regression model was expressed by the equation 


у = В+ Вх +€ (11.4.1) 


in which у is an arbitrary observed value of the continuous dependent variable. When the 
observed value of Y is uy, the mean of a subpopulation of Y values for a given value of X, 
the quantity e, the difference between the observed Y and the regression line (see 
Figure 9.2.1) is zero, and we may write Equation 11.4.1 as 


мух = Bo + Bix (11.4.2) 
which may also be written as 
E(y|x) = бу + Вх (11.4.3) 


Generally, the right-hand side of Equations (11.4.1) through (11.4.3) may assume any value 
between minus infinity and plus infinity. 

Even though only two variables are involved, the simple linear regression model is 
not appropriate when Y is a dichotomous variable because the expected value (or mean) 
of Y is the probability that Y — 1 and, therefore, is limited to the range O through 1, 
inclusive. Equations (11.4.1) through (11.4.3), then, are incompatible with the reality of 
the situation. 

If we let p = P(Y = 1), then the ratio p/(1 — p) can take on values between 0 and 
plus infinity. Furthermore, the natural logarithm (In) of p/(1 — p) can take on values 
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between minus infinity and plus infinity just as can the right-hand side of Equations 11.4.1 
through (11.4.3). Therefore, we may write 


in| E NTE (11.4.4) 
1—р 


Equation 11.4.4 is called the logistic regression model and the transformation of шу; 
(that is, p) to шр/(1 — p)] is called the logit transformation. Equation 11.4.4 may also be 
written as 


explo + Вид 
1 + ехр( Ву + Вх) 


(11.4.5) 


in which exp is the inverse of the natural logarithm. 

The logistic regression model is widely used in health sciences research. For 
example, the model is frequently used by epidemiologists as a model for the probability 
(interpreted as the risk) that an individual will acquire a disease during some specified time 
period during which he or she is exposed to a condition (called a risk factor) known to be or 
suspected of being associated with the disease. 


Logistic Regression: Dichotomous Independent Variable The 
simplest situation in which logistic regression is applicable is one in which both the 
dependent and the independent variables are dichotomous. The values of the dependent 
(or outcome) variable usually indicate whether or not a subject acquired a disease or 
whether or not the subject died. The values of the independent variable indicate the 
status of the subject relative to the presence or absence of some risk factor. In the 
discussion that follows we assume that the dichotomies of the two variables are coded 
0 and 1. When this is the case the variables may be cross-classified in a table, such as 
Table 11.4.1, that contains two rows and two columns. The cells of the table contain 
the frequencies of occurrence of all possible pairs of values of the two variables: (1, 1), 
(1, 0), (0, 1), and (0, 0). 

An objective of the analysis of data that meet these criteria is a statistic known as the 
odds ratio. To understand the concept of the odds ratio, we must understand the term odds, 


TABLE 11.4.1 Two Cross-Classified 
Dichotomous Variables Whose Values 
Are Coded 1 and O 


Independent 
Variable (X) 
Dependent ————— 
Variable (Y) 1 0 
1 Ma nio 


2 пол Noo 
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which is frequently used by those who place bets on the outcomes of sporting events or 
participate in other types of gambling activities. Using probability terminology, we may 
define odds as follows. 


DEFINITION 


The odds for success is the ratio of the probability of success to the 
probability of failure. 


The odds ratio is a measure of how much greater (or less) the odds are for subjects 
possessing the risk factor to experience a particular outcome. This conclusion assumes that 
the outcome is a rare event. For example, when the outcome is the contracting of a disease, 
the interpretation of the odds ratio assumes that the disease is rare. 

Suppose, for example, that the outcome variable is the acquisition or nonacquisition 
of skin cancer and the independent variable (or risk factor) is high levels of exposure to the 
sun. Analysis of such data collected on a sample of subjects might yield an odds ratio of 2, 
indicating that the odds of skin cancer are two times higher among subjects with high levels 
of exposure to the sun than among subjects without high levels of exposure. 

Computer software packages that perform logistic regression frequently provide as 
part of their output estimates of Ву and £; and the numerical value of the odds ratio. As it 
turns out the odds ratio is equal to exp(f,). 


EXAMPLE 11.4.1 


LaMont et al. (A-9) tested for obstructive coronary artery disease (OCAD) among 113 men 
and 35 women who complained of chest pain or possible equivalent to their primary care 
physician. Table 11.4.2 shows the cross-classification of OCAD with gender. We wish to 
use logistic regression analysis to determine how much greater the odds are of finding 
OCAD among men than among women. 


Solution: We may use the SAS? software package to analyze these data. The 
independent variable is gender and the dependent variable is status with 
respect to having obstructive coronary artery disease (OCAD). Use of the 
SAS? command PROC LOGIST yields. as part of the resulting output, the 
statistics shown in Figure 11.4.1. 


TABLE 11.4.2 Cases of Obstructive Coronary 
Artery Disease (OCAD) Classified by Sex 


Disease Males Females Total 
OCAD present 92 15 107 
OCAD not present 21 20 41 


Total 113 35 148 


Source: Data provided courtesy of Matthew J. Budoff, M.D. 
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The LOGISTIC Procedure 


Analysis of Maximum Likelihood Estimates 


Parameter DF Estimate Standard Wald 
Error Chi-Square Pr > ChiSq 


Intercept -0.2877 0.3416 0.7090 0.3997 
sex 1.7649 0.4185 17.7844 <.0001 


FIGURE 11.4.1 Partial output from use of SAS? command PROC LOGISTIC with the data ої 
Table 11.4.2. 


We see that the estimate of a is —0.2877 and the estimate of f, is 
1.7649. The estimated odds ratio, then, is OR — exp(1.7649) — 5.84. Thus, 
we estimate that the odds of finding a case of obstructive coronary artery 
disease to be almost six times higher among men than women. и 


Logistic Regression: Continuous Independent Variable Now let 
us consider the situation in which we have a dichotomous dependent variable and a 
continuous independent variable. We shall assume that a computer is available to perform 
the calculations. Our discussion, consequently, will focus on an evaluation of the adequacy 
of the model as a representation of the data at hand, interpretation of key elements of the 
computer printout, and the use of the results to answer relevant questions about the 
relationship between the two variables. 


EXAMPLE 11.4.2 


According to Gallagher et al. (A-10), cardiac rehabilitation programs offer "information, 
support, and monitoring for return to activities, symptom management, and risk factor 
modification." The researchers conducted a study to identify among women factors that are 
associated with participation in such programs. The data in Table 11.4.3 are the ages of 185 
women discharged from a hospital in Australia who met eligibility criteria involving 
discharge for myocardial infarction, artery bypass surgery, angioplasty, or stent. We wish to 
use these data to obtain information regarding the relationship between age (years) and 
participation in a cardiac rehabilitation program (ATT = 1, if participated, and ATT = 0, 
if not). We wish also to know if we may use the results of our analysis to predict the 
likelihood of participation by a woman if we know her age. 


Solution: The independent variable is the continuous variable age (AGE), and the 
dependent or response variable is status with respect to attendance in a 
cardiac rehabilitation program. The dependent variable is a dichotomous 
variable that can assume one of two values: 0 — did not attend, and 1 — did 
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TABLE 11.4.3 Ages of Women Participating and Not 
Participating in a Cardiac Rehabilitation Program 


Nonparticipating Participating 

(ATT = 0) (ATT = 1) 
50 73 46 74 74 62 
59 75 57 59 50 74 
42 71 53 81 55 61 
50 69 40 74 66 69 
34 78 73 77 49 76 
49 69 68 59 55 71 
67 74 72 75 73 61 
44 86 59 68 41 46 
53 49 64 81 64 69 
45 63 78 74 46 66 
79 63 68 65 65 57 
46 72 67 81 50 60 
62 64 55 62 61 63 
58 72 71 85 64 63 
70 79 80 84 59 56 
60 75 75 39 73 70 
67 70 69 52 73 70 
64 73 80 67 65 63 
62 66 79 82 67 63 
50 75 71 84 60 65 
61 73 69 79 69 67 
69 71 78 81 61 68 
74 72 75 74 79 84 
65 69 71 85 66 69 
80 76 69 92 68 78 
69 60 77 69 61 69 
77 79 81 83 63 79 
61 78 78 82 70 83 
72 62 76 85 68 67 
67 73 84 82 59 47 
80 64 57 
66 


Source: Data provided courtesy of Robyn Gallagher, R.N., Ph.D. 


attend. We use the SAS® software package to analyze the data. The SAS® 
command is PROC LOGISTIC, but if we wish to predict attendance in the 
cardiac program, we need to use the “descending” option with PROC 
LOGISTIC. (When you wish to predict the outcome labeled “1” of the 
dependent variable, use the “descending option” in SAS?. Consult 
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Standard Wald 
Parameter Estimate Error Chi-Square Pr » ChiSq 


Intercept 1.8744 0.9809 3.6518 0.0560 
age —0.0379 0.0146 6.7083 0.0096 


FIGURE 11.4.2 Partial SAS? printout of the logistic regression analysis of the data in Table 11.4.3. 


ЗАЗ documentation for further details.) А partial printout of the analysis is 
shown in Figure 11.4.2. 

The slope of our regression is —.0379, and the intercept is 1.8744. The 
regression equation, then, is 


У; = 1.8744 — .0379xj 


where У; = In[f;(1 — p;)| and р; is the predicted probability of attending 
cardiac rehabilitation for a woman aged x;. 


Test of Но that B, = 0 


We reach a conclusion about the adequacy of the logistic model by testing the null 
hypothesis that the slope of the regression line is zero. The test statistic is z — В 1/ 58, where 
z is the standard normal statistic, f, is the sample slope (—.0379), and 58, is its standard 
error (.0146) as shown in Figure 11.4.2. From these numbers we compute z— 
—.0379/.0146 — —2.5959, which has an associated two-sided p value of .0094. We 
conclude, therefore, that the logistic model is adequate. The square of z is chi-square 
with 1 degree of freedom, a statistic that is shown in Figure 11.4.2. 


Using the Logistic Regression to Estimate p 


We may use Equation 11.4.5 and the results of our analysis to estimate p, the probability 
that a woman of a given age (within the range of ages represented by the data) will 
attend a cardiac rehabilitation program. Suppose, for example, that we wish to estimate 
the probability that a woman who is 50 years of age will participate in a rehabilitation 
program. Substituting 50 and the results shown in Figure 11.4.2 into Equation 11.4.5 
gives 


exp[1.8744 — (.0379)(50)] 


b= = 494 
P= TT exp[1.8744 — (0379)(50)) A 


SAS® calculates the estimated probabilities for the given values of X. We can see the 
estimated probabilities of attending cardiac rehabilitation programs for the age range 
of the subjects enrolled in the study in Figure 11.4.3. Since the slope was negative, 
we see a decreasing probability of attending a cardiac rehabilitation program for older 
women. 


576 


CHAPTER 11 REGRESSION ANALYSIS: SOME ADDITIONAL TECHNIQUES 


0.65 - 


0.60 — 


0.55 - e 


0.50 — ° 


0.45 - 5 


0.40 — ° 


0.35 |- е 


Estimated probability 


0.30 = LA 


0.25 H °. 


0.20 - e. 


A | PA 
30 40 50 60 70 80 90 100 
FIGURE 11.4.3 Estimated probabilities of attendance for ages within the study for 
Example 11.4.2. | | 


Multiple Logistic Regression Practitioners often are interested in the rela- 
tionships of several independent variables to a response variable. These independent 
variables may be either continuous or discrete or a combination of the two. 

Multiple logistic models are constructed by expanding Equations (11.4.1) to (11.4.4). 
If we begin with Equation 11.4.4, multiple logistic regression can be represented as 


Zr а = Bo + Вуху + Byxoj +++ + Вуху (11.4.6) 
Using the logit transformation, we now һауе 


x exp(Bo + Bixij + В; + +++ + бух) 
1 +exp(Bo + Віху + Boxy +--+ + Вуху) 


(11.4.7) 


EXAMPLE 11.4.3 


Consider the data presented in Review Exercise 24. In this study by Fils-Aime et al. (A-21), 
data were gathered and classified with regard to alcohol use. Subjects were classified 
as having either early (< 25 years) or late (> 25 years) onset of excessive alcohol use. 
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Parameter S.E. Wald 


5-HIAA р .006 5.878 
ТВУРТ 5 .000 .000 
Constant > 1.049 3.918 


FIGURE 11.4.4 SPSS output for the data in Example 11.4.3. 


Levels of cerebrospinal fluid (CSF) tryptophan (TRYPT) and 5-hydroxyindoleacetic acid 
(5-HIAA) concentrations were also obtained. 


Solution: The independent variables are the concentrations of TRYPT and 5-HIAA, and 
the dependent variable is the dichotomous response for onset of excessive 
alcohol use. We use SPSS software to analyze the data. The output is 
presented in Figure 11.4.4. 

The equation can be written as 


ӯ, = 2.076 — 013ху + Oxy 


Note that the coefficient for TRYPT is 0, and therefore it is not playing a role in the 
model. 


Test of Но that 8, = 0 


Tests for significance of the regression coefficients can be obtained directly from 
Figure 11.4.4. Note that both the constant (intercept) and the 5-HIAA variables are 
significant in the model (both have p values, noted as “Sig.” in the table, <.05); however, 
TRYPT is not significant and therefore need not be in the model, suggesting that it is not 
useful for identifying those study participants with early or late alcoholism onset. 

As above, probabilities can be easily obtained by using Equation 11.4.7 and 
substituting the values obtained from the analysis. A 


Assessing Goodness of Fit А natural question that arises when doing logistic 
regression is: “How good is my model?" In classical linear regression we discussed 
measures such as R? for determining how much variation is explained by the model, with 
values of R? approaching 1 as a good indicator of model adequacy based on the predictors 
chosen to model the outcome. Given the nature of the response variable in logistic 
regression, a coefficient of determination does not provide the same information as it does 
in linear regression. This is because in logistic regression values of the parameters are not 
derived to minimize sums of squares, but rather are iterative estimates; hence, there is no 
equivalent measure of R? in logistic regression. Below, we provide an explanation of some 
commonly used approaches to evaluate logistic regression models, and follow these 
explanations with two illustrative examples. 

Many authors have attempted to develop what are known as “pseudo-R”” values that 
range from О to 1, with higher values indicating better fit. In general, these measures are 
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based on comparisons of a derived model with a model that contains only an intercept. In 
other words, they are comparative measures designed to indicate “how much better” a 
model with predictor variables is when compared to a model with no predictors. Two 
commonly used pseudo-R? statistics were developed by Cox and Snell (4) and Nagelkerke 
(5). These are often provided in standard outputs of statistical software. The value of these 
measures is the fact that they may be useful for comparing models with different predictor 
variables, but provide little relative use for examining a single model. Both of these 
approaches are based on the idea of using a measure of fit known as the log-likelihood 
statistic. The log-likelihood for the intercept-only model is used to represent the total sum 
of squares, while the log-likelihood for the model with predictor variables is used to 
represent the error sum of squares. Interested readers may find an explanation of the log- 
likelihood statistic in Hosmer and Lemeshow (2). 

Another intuitive approach is to consider a classification table. Using this method, 
one develops a contingency table that provides frequency counts of the number of data 
points that were observed to be either 0 or 1 in the raw data, along with whether the raw data 
were classified as O or 1 based on the predictive equation. One can then estimate how many 
of the data points were correctly classified. As a general rule-of-thumb, correctly 
classifying 70 percent or greater is considered evidence of a satisfactory model from a 
statistical viewpoint. However, the model may not provide great enough predictive ability 
to be useful in a practice sense. A problem does arise, however, in that reclassifying the 
same data used to build a model with the model itself may bias the results. There are two 
practical ways to deal with this issue. First, one may use part of the data set to construct the 
model and the other part of the data set to develop a classification table. This strategy, of 
course, requires a sample large enough to accommodate adequately the needs of both 
procedures. A second approach is to construct a model using the data in hand and then 
collect additional data to test the adequacy of the model using a classification table. This 
strategy, too, has its shortcomings, as the collection of additional data can be both time- 
consuming and expensive. 

A third approach that also has intuitive visual appeal is to develop a plot that shows 
the frequency of observations against their predicted probability. In this type of plot, one 
would hope to see a complete separation of O and 1 values. When there is misclassification 
of the outcome variable, this type of plot provides a means of determining where the 
misclassification occurred, and how frequently observations were misclassified. 

Finally, in a commonly used approach known as the Hosmer and Lemeshow test, one 
develops a table of observed and expected frequencies and uses a chi-square test to 
determine if there is a significant deviation between the observed and expected frequen- 
cies. For the interested reader, we suggest the text by Hosmer and Lemeshow (2). 


EXAMPLE 11.4.4 


Consider the logistic regression model that was constructed from the cardiac rehabilitation 
program data in Example 11.4.2. 

Figure 11.4.5 shows standard SPSS output for this logistic regression model. In this 
figure, we see that both the Cox and Snell and the Nagelkerke pseudo-R? values are 
provided. Since they are both > 0, the model with the predictor provides more information 
than the intercept-only model. One can readily see that only 63% of the data were correctly 
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Model Summary 
Cox & Snell R Nagelkerke R 


Square Square 


Classification Table? 
Predicted 


Percentage 


Observed Correct 


1 


Overall Percentage 


Observed Groups and Predicted Probabilities 


16 * * 

I I 

I 11 H 

E I 1 11 I 
R 12 + 1 11 * 
E I 1 11 т 
е І 0 11 I 
Uu I 0 0 01 т 
Е 8 + 0 10 00 + 
N I 01 10 00 11 I 
с І 1 01110001 00 1111 І 
Y I 1 00000000100111111 1 1 т 
4+ 00 00000000100111101101 1 1 * 

I 00000000000100110101101 1 01 1 I 

I 00000000000000100000000 10 00 0 1 I 

I 0  0000000000000000000000010 00 00 1000 000 о І 
Predicted --------- qure dL SR Чана == === === === 4--------- be 
Prob: 0 S .2 .3 E 25 .6 ҮТ .8 .9 1 


Group:  0000000000000000000000000000000000000000000000000011111111111111111111111111111111111111111111111111 


FIGURE 11.4.5 Partial SPSS output for the logistic regression analysis of the data in Example 
11.4.2. 


reclassified, with those participating in the rehabilitation program much more poorly classi- 
fied than those who did not attend the program. The frequency distribution shows the large 
number of ATT — 1 subjects who were misclassified as ATT — 0 based on the model. El 


EXAMPLE 11.4.5 


Consider the logistic regression model that was constructed from the cardiac rehabilitation 
program data in Example 11.4.3. 

Figure 11.4.6 shows standard SPSS output for this logistic regression model. In this 
figure, we see that both the Cox and Snell and the Nagelkerke pseudo-R? values are provided, 
and since they are both > 0, the model with the predictors provides more information than 
the intercept-only model. One can readily see that only 69% of the data were correctly 
reclassified, with the model reclassifying those with onset of excessive alcohol use at a much 
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Model Summary 
Cox & Snell R Nagelkerke R 


Square Square 


Classification Table? 
Predicted 
Onset Percentage 


Observed Correct 


onset 


1 


Overall Percentage 


a. The cut value is. 500 


Observed Groups and Predicted Probabilities 


16 * * 

I I 

I І 

E: I I 
R 12 + + 
E I I 
о І І 
U I Я I 
E 84 1 1 + 
N I 1 11 1 I 
с т 4 111 1111 11 т 
Y I 1 11111110 111 т 
4+ 1 0 11111110 1111 * 

I 11 10 11110110 11111111 I 

I 111 10110101010010111111111 т 

т 0 01 1 1 000111 000 00000000010000100111010011 I 
Predicted --------- *--------- d---————— ester == ======5 Ж======--= +--------- +--------- +--------- +---------- 
Prob: 0 Ж .2 .3 E .5 .6 Л .8 .9 1 


Group: 0000000000000000000000000000000000000000000000000011111111111111111111111111111111111111111111111111 


FIGURE 11.4.6 Partial SPSS output for the logistic regression analysis of the data in Example 11.4.3. 


higher rate than those without such onset. The frequency distribution shows the large number 
of those without onset of excessive alcohol use predicted by the model to develop early onset 
of alcoholism. [| 


Polytomous Logistic Regression Thus far we have limited our discussion 
to situations in which there is a dichotomous response variable (e.g., successful or 
unsuccessful). Often, we have a situation in which multiple categories make up the 
response. We may, for example, have subjects that are classified as positive, negative, and 
undetermined for a given disease (a standard polytomous response). There may also be 
times when we have a response variable that is ordered. We may, for example, classify our 
subjects by BMI as underweight, ideal weight, overweight, or obese (an ordinal poly- 
tomous response). The modeling process is slightly more complex and requires the use of a 
computer program. For those interested in exploring these valuable methods further, we 
recommend the book by Hosmer and Lemeshow (2). 
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Further Reading We have discussed only the basic concepts and applications of 
logistic regression. The technique has much wider application. Stepwise regression analysis 
may be used with logistic regression. There are also techniques available for constructing 
confidence intervals for odds ratios. The reader who wishes to learn more about logistic 
regression may consult the books by Hosmer and Lemeshow (2) and Kleinbaum (3). 


EXERCISES 


11.4.1 


11.4.2 


In a study of violent victimization of women and men, Porcerelli et al. (A-11) collected information 
from 679 women and 345 men ages 18 to 64 years at several family-practice centers in the 
metropolitan Detroit area. Patients filled out a health history questionnaire that included a question 
about victimization. The following table shows the sample subjects cross-classified by gender and 
whether the subject self-identified as being “hit, kicked, punched, or otherwise hurt by someone 
within the past year.” Subjects answering yes to that question are classified “violently victimized.” 
Use logistic regression analysis to find the regression coefficients and the estimate of the odds ratio. 
Write an interpretation of your results. 


Victimization Women Men Total 
No victimization 611 308 919 
Violently victimized 68 37 105 
Total 679 345 1024 


Source: John H. Porcerelli, Rosemary Cogan, Patricia P. West, Edward A. Rose, Dawn 
Lambrecht, Karen E. Wilson, Richard K. Severson, and Dunia Karana, “Violent Victimization 
of Women and Men: Physical and Psychiatric Symptoms," Journal of the American Board of 
Family Practice, 16 (2003), 32-39. 


Refer to the research of Gallagher et al. (A-10) discussed in Example 11.4.2. Another covariate of 
interest was a score using the Hospital Anxiety and Depression Index. A higher value for this score 
indicates a higher level of anxiety and depression. Use the following data to predict whether a woman 
in the study participated in a cardiac rehabilitation program. 


Hospital Anxiety 
and Depression 
Index Scores for 


Hospital Anxiety and Depression Index Participating 
Scores for Nonparticipating Women Women 

17 14 19 16 23 25 

7 21 6 9 3 6 
19 13 8 22 24 29 
16 15 13 17 13 22 
23 21 4 14 26 11 
27 12 15 14 19 12 
23 9 23 5 25 20 
18 29 19 5 15 18 
21 4 14 14 22 24 
27 18 19 20 13 18 
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Hospital Anxiety 
and Depression 
Index Scores for 


Hospital Anxiety and Depression Index Participating 
Scores for Nonparticipating Women Women 

14 22 17 21 21 8 
25 5 13 17 15 10 
19 27 14 17 12 17 
23 16 14 10 25 14 

6 11 17 13 29 21 

8 19 26 10 17 25 
15 23 15 20 21 25 
30 22 19 3 8 16 
18 25 16 18 19 23 
10 11 10 9 16 19 
29 20 15 10 24 24 

8 11 22 5 17 11 
12 28 8 15 26 17 
27 12 15 13 12 19 
12 19 20 16 19 20 

9 18 12 13 17 
16 13 2 23 31 

6 12 6 11 0 
22 7 14 17 18 
10 12 19 29 18 

9 14 14 6 15 
11 13 19 20 


Source: Data provided courtesy of Robyn Gallagher, R.N., Ph.D. 


11.5 SUMMARY 


This chapter is included for the benefit of those who wish to extend their understanding of 
regression analysis and their ability to apply techniques to models that are more complex 
than those covered in Chapters 9 and 10. In this chapter we present some additional topics 
from regression analysis. We discuss the analysis that is appropriate when one or more of 
the independent variables is dichotomous. In this discussion the concept of dummy 
variable coding is presented. A second topic that we discuss is how to select the most 
useful independent variables when we have a long list of potential candidates. The 
technique we illustrate for the purpose is stepwise regression analysis. Finally, we present 
the basic concepts and procedures that are involved in logistic regression analysis. We 
cover two situations: the case in which the independent variable is dichotomous, and the 
case in which the independent variable is continuous. 

Since the calculations involved in obtaining useful results from data that are 
appropriate for analysis by means of the techniques presented in this chapter are 
complicated and time-consuming when attempted by hand, it is recommended that a 
computer be used to work the exercises. 
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SUMMARY OF FORMULAS FOR CHAPTER 11 


Formula 

Number Name Formula 

11.4.1- Representations of the simple у = Bo + Вх Е 

11.4.3 linear regression model Шух = Bo + Bix 

Eol) = Bo + Вах 

11.4.4 Simple logistic regression model | п | тА | = fy Bux 

11.4.5 Alternative representation of the |. exp(fo + Bix) 
simple logistic regression model 1 +exp(Bo + Вх) 

11.4.6 Alternative representation of the In | 1; | = By + Бух + Воо + --- + Bug 
multiple logistic regression model 

11.4.7 Alternative representation of the exp(Bo + Bixi + Вох Б 4 By) 
multiple logistic regression model | 14 exp(Bo F Bixi + bay t Pixy) 


Symbol є Во = regression intercept 

Key * p, — regression coefficient 

* є = regression model error term 
• Evy) = expected value of y atx 


* In РА = log it transformation 


* муу = mean of yatx 
* x; = value of independent variable at 
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= B 
m rom 


Or 905. E UP МЭ asm 


What is a qualitative variable? 

What is a dummy variable? 

Explain and illustrate the technique of dummy variable coding. 

Why is a knowledge of variable selection techniques important to the health sciences researcher? 
What is stepwise regression? 

Explain the basic concept involved in stepwise regression. 

When is logistic regression used? 

Write out and explain the components of the logistic regression model. 

Define the word odds. 

What is an odds ratio? 


Give an example in your field in which logistic regression analysis would be appropriate when the 
independent variable is dichotomous. 
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13. 


14. 


Give an example in your field in which logistic regression analysis would be appropriate when the 
independent variable is continuous. 


Find a published article in the health sciences field in which each of the following techniques is employed: 
(a) Dummy variable coding 

(b) Stepwise regression 

(c) Logistic regression 

Write a report on the article in which you identify the variables involved, the reason for the choice of 
the technique, and the conclusions that the authors reach on the basis of their analysis. 


In Example 10.3.1, we saw that the purpose of a study by Jansen and Keller (A-12) was to predict the 
capacity to direct attention (CDA) in elderly subjects. The study collected information on 71 
community-dwelling older women with normal mental status. Higher CDA scores indicate better 
attentional functioning. In addition to the variables age and education level, the researchers 
performed stepwise regression with two additional variables: IADL, a measure of activities of 
daily living (higher values indicate greater number of daily activities), and ADS, a measure of 
attentional demands (higher values indicate more attentional demands). Perform stepwise regression 
with the data in the following table and report your final model, p values, and conclusions. 


CDA Age Edyrs IADL ADS CDA Age Edyrs IADL ADS 
4.57 72 20 28 27 3.17 79 12 28 18 
—3.04 68 12 27 96 —1.19 87 12 21 61 
1.39 65 13 24 97 0.99 71 14 28 55 
—3.55 85 14 27 48 —2.94 81 16 27 124 
—2.56 84 13 28 50 —2.21 66 16 28 42 
—4.66 90 15 27 47 —0.75 81 16 28 64 
—2.70 79 12 28 71 5.07 80 13 28 26 
0.30 74 10 24 48 —5.86 82 12 28 84 
—4.46 69 12 28 67 5.00 65 13 28 43 
—6.29 87 15 21 81 0.63 73 16 26 70 
—4.43 84 12 27 44 2.62 85 16 28 20 
0.18 79 12 28 39 1.77 83 17 23 80 
—1.37 71 12 28 124 —3.79 83 8 27 21 
3.26 76 14 29 43 1.44 76 20 28 26 
—1.12 73 14 29 30 —5.77 77 12 28 53 
—0.77 86 12 26 44 —5.77 83 12 22 69 
3.73 69 17 28 47 —4.62 79 14 27 82 
—5.92 66 11 28 49 —2.03 69 12 28 77 
5.74 65 16 28 48 —222 66 14 28 38 
2.83 71 14 28 46 0.80 75 12 28 28 
2.40 80 18 28 25 —0.75 77 16 27 85 
—0.29 81 11 28 27 —4.60 78 12 22 82 
4.44 66 14 29 54 2.68 83 20 28 34 
3.35 76 17 29 26 —3.69 85 10 20 72 
—3.13 70 12 25 100 4.85 76 18 28 24 
—2.14 76 12 27 38 —0.08 75 14 29 49 
9.61 67 12 26 84 0.63 70 16 28 29 
7.57 72 20 29 44 5.92 79 16 27 83 


(Continued ) 
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CDA Age Edyrs IADL ADS CDA Age Edyrs IADL ADS 


2.21 68 18 28 52 3.63 75 18 28 32 
—2.30 102 12 26 18 —1.07 94 8 24 80 
1.73 67 12 27 80 6.39 76 18 28 41 
6.03 66 14 28 54 —0.08 84 18 21 75 
—0.02 75 18 26 67 1.07 79 17 27 21 
—7.65 91 13 21 101 5.31 78 16 28 18 
4.17 74 15 28 90 0.30 79 12 28 38 


Source: Data provided courtesy of Debra Jansen, Ph.D., R.N. 


In the following table are the cardiac output (L/min) and oxygen consumption (Vo,) values for a 
sample of adults (A) and children (C), who participated in a study designed to investigate the 
relationship among these variables. Measurements were taken both at rest and during exercise. Treat 
cardiac output as the dependent variable and use dummy variable coding and analyze the data by 
regression techniques. Explain the results. Plot the original data and the fitted regression equations. 


Cardiac Vo, Age Cardiac Vo, 

Output (L/min) (L/min) Group Output (L/min) (L/min) Age Group 
4.0 21 A 4.0 25. C 
TS 91 С 6.1 22, A 
3.0 22 C 6.2 .61 С 
8.9 .60 А 4.9 45 C 
5.1 .59 С 14.0 1.55 А 
5.8 .50 А 12.9 1.11 А 
9.1 .99 А 11.3 1.45 А 
3.5 .23 С 5.7 .50 С 
57:2 .51 А 15.0 1.61 А 
5.1 .48 С 7.1 .83 С 
6.0 174 C 8.0 .61 A 
5.7 70 C 8.1 .82 A 

14.2 1.60 A 9.0 1.15 C 
4.1 .30 C 6.1 .39 A 


A simple random sample of normal subjects between the ages of 6 and 18 yielded the data on total 
body potassium (mEq) and total body water (liters) shown in the following table. Let total potassium 
be the dependent variable and use dummy variable coding to quantify the qualitative variable. 
Analyze the data using regression techniques. Explain the results. Plot the original data and the fitted 
regression equations. 


Total Body Total Body Total Body Total Body 

Potassium Water Sex Potassium Water Sex 
795 13 M 950 12 F 

1590 16 F 2400 26 M 

1250 15 M 1600 24 F 

1680 21 M 2400 30 M 


(Continued ) 
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18. 


Total Body Total Body Total Body Total Body 
Potassium Water Sex Potassium Water Sex 
800 10 F 1695 26 F 
2100 26 M 1510 21 F 
1700 15 F 2000 27 F 
1260 16 M 3200 33 M 
1370 18 F 1050 14 F 
1000 11 F 2600 31 M 
1100 14 M 3000 37 M 
1500 20 F 1900 25 F 
1450 19 M 2200 30 F 
1100 14 M 


The data shown in the following table were collected as part of a study in which the subjects were 
preterm infants with low birth weights born in three different hospitals. Use dummy variable coding 
and multiple regression techniques to analyze these data. May we conclude that the three sample 
hospital populations differ with respect to mean birth weight when gestational age is taken into 
account? May we conclude that there is interaction between hospital of birth and gestational age? 
Plot the original data and the fitted regression equations. 


Birth Gestation Hospital Birth Gestation Hospital 
Weight (kg) Age (weeks) of Birth Weight (kg) Age (weeks) of Birth 
1.4 30 A 1.0 29 C 
9 27 B 1.4 33 C 
1.2 33 A 9 28 А 
1.1 29 C 1.0 28 C 
1:3 35 A 1.9 36 B 
8 27 B 1.3 29 B 
1.0 32 A 1.7 35 C 
57 26 А 1.0 30 А 
1.2 30 C 9 28 А 
8 28 A 1.0 31 A 
1.5 32 B 1.6 31 B 
1.3 31 A 1.6 33 B 
1.4 32 C 1.7 34 B 
1.5 33 B 1.6 35 C 
1.0 27 A 1.2 28 A 
1.8 35 B 1.5 30 B 
1.4 36 C 1.8 34 B 
1.2 34 A 1.5 34 C 
1.1 28 B 1.2 30 A 
1.2 30 B 1.2 32 C 


Refer to Chapter 9, Review Exercise 18. In the study cited in that exercise, Maria Mathias (A-13) 
investigated the relationship between ages (AGE) of boys and improvement in measures of 
hyperactivity, attitude, and social behavior. In the study, subjects were randomly assigned to two 
different treatments. The control group (TREAT = 0) received standard therapy for hyperactivity, 
and the treatment group (TREAT = 1) received standard therapy plus pet therapy. The results are 
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shown in the following table. Create a scatter plot with age as the independent variable and ATT 
(change in attitude with positive numbers indicating positive change in attitude) as the dependent 
variable. Use different symbols for the two different treatment groups. Use multiple regression 
techniques to determine whether age, treatment, or the interaction are useful in predicting ATT. 
Report your results. 


Subject TREAT AGE ATT Subject TREAT AGE ATT 
1 1 9 —1.2 17 0 10 0.4 
2 1 9 0.0 18 0 7 0.0 
3 1 13 —0.4 19 0 12 1.1 
4 1 6 —0.4 20 0 9 0.2 
5 1 9 1.0 21 0 7 0.4 
6 1 8 0.8 22 0 6 0.0 
T 1 8 —0.6 23 1 11 0.6 
8 1 9 —1.2 24 1 11 0.4 
9 0 7 0.0 25 1 11 1.0 

10 0 12 0.4 26 1 11 0.8 

11 0 9 —0.8 27 1 11 1.2 

12 0 10 1.0 28 1 11 0.2 

13 0 12 1.4 29 1 11 0.8 

14 0 9 1.0 30 1 8 0.0 

15 0 12 0.8 31 1 9 0.4 

16 0 9 1.0 


Source: Data provided courtesy of Maria Mathias, M.D. and the Wright State University Statistical Consulting 
Center. 


For each study described in Exercises 19 through 21, answer as many of the following questions as 
possible: 


(a) Which is the dependent variable? 

(b) What are the independent variables? 

(c) What are the appropriate null and alternative hypotheses? 
(d) Which null hypotheses do you think were rejected? Why? 


(e) Which is the more relevant objective, prediction or estimation, or are the two equally relevant? 
Explain your answer. 


(f) What is the sampled population? 
(g) What is the target population? 


(h) Which variables are related to which other variables? Are the relationships direct or 
inverse? 


(i) Write out the regression equation using appropriate numbers for parameter estimates. 

(j) Give numerical values for any other statistics that you can. 

(k) Identify each variable as to whether it is quantitative or qualitative. 

(I) Explain the meaning of any statistics for which numerical values are given. 

Golfinopoulos and Arhonditsis (A-14) used a multiple regression model in a study of trihalomethanes 


(THMs) in drinking water in Athens, Greece. THMs are of concern since they have been related to 
cancer and reproductive outcomes. The researchers found the following regression model useful in 


588 


CHAPTER 11 REGRESSION ANALYSIS: SOME ADDITIONAL TECHNIQUES 


20. 


21. 


22. 


predicting THM: 


THM = —.26chla + 1.57 pH + 28.74Br — 66.72Br? 
43.635 + 1.135р + 2.62T x S — ЛОТ x CL 


The variables were as follows: chla = chlorophyll concentration, pH = acid/base scale, 
Br = bromide concentration, $ = dummy variable for summer, Sp = dummy variable for spring, 
T — Temperature, and CL — chlorine concentration. The researchers reported R — .52, p « .001. 


In a study by Takata et al. (A-15), investigators evaluated the relationship between chewing ability 
and teeth number and measures of physical fitness in a sample of subjects ages 80 or higher in Japan. 
One of the outcome variables that measured physical fitness was leg extensor strength. To measure 
the ability to chew foods, subjects were asked about their ability to chew 15 foods (peanuts, vinegared 
octopus, and French bread, among others). Consideration of such variables as height, body weight, 
gender, systolic blood pressure, serum albumin, fasting glucose concentration, back pain, smoking, 
alcohol consumption, marital status, regular medical treatment, and regular exercise revealed that the 
number of chewable foods was significant in predicting leg extensor strength (8 1 = 075,р = .0366). 


However, in the presence of the other variables, number of teeth was not a significant predictor 
(B, — .003, p — .9373). 


Varela et al. (A-16) examined 515 patients who underwent lung resection for bronchogenic 
carcinoma. The outcome variable was the occurrence of cardiorespiratory morbidity after surgery. 
Any of the following postoperative events indicated morbidity: pulmonary atelectasis or pneu- 
monia, respiratory or ventilatory insufficiency at discharge, need for mechanical ventilation at any 
time after extubation in the operating room, pulmonary thromboembolism, arrhythmia, myocar- 
dial ischemia or infarct, and clinical cardiac insufficiency. Performing a stepwise logistic 
regression, the researchers found that age (p « .001) and postoperative forced expiratory volume 
(p = .003) were statistically significant in predicting the occurrence of cardiorespiratory 
morbidity. 


For each of the data sets given in Exercises 22 through 29, do as many of the following as you think 

appropriate: 

(a) Apply one or more of the techniques discussed in this chapter. 

(b) Apply one or more of the techniques discussed in previous chapters. 

(c) Construct graphs. 

(d) Formulate relevant hypotheses, perform the appropriate tests, and find p values. 

(e) State the statistical decisions and clinical conclusions that the results of your hypothesis tests 
justify. 


(f) Describe the population(s) to which you think your inferences are applicable. 


A study by Davies et al. (A-17) was motivated by the fact that, in previous studies of contractile 
responses to f-adrenoceptor agonists in single myocytes from failing and nonfailing human 
hearts, they had observed an age-related decline in maximum response to isoproterenol, at 
frequencies where the maximum response to high Са?" in the same cell was unchanged. For the 
present study, the investigators computed the isoproterenol/Ca?* ratio (ISO/CA) from measure- 
ments taken on myocytes from patients ranging in age from 7 to 70 years. Subjects were 
classified as older (> 50 years) and younger. The following are the (ISO/CA) values, age, 
and myocyte source of subjects in the study. Myocyte sources were reported as donor and 
biopsy. 
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Age ISO/CA Myocyte Source 
7 1.37 Donor 
21 1.39 Donor 
28 1.17 Donor 
35 0.71 Donor 
38 1.14 Donor 
50 0.95 Donor 
51 0.86 Biopsy 
52 0.72 Biopsy 
55 0.53 Biopsy 
56 0.81 Biopsy 
61 0.86 Biopsy 
70 0.77 Biopsy 


Source: Data provided courtesy of Dr. Sian E. Harding. 


Hayton et al. (A-18) investigated the pharmacokinetics and bioavailability of cefetamet and 
cefetamet pivoxil in infants between the ages of 3.5 and 17.3 months who had received the antibiotic 
during and after urological surgery. Among the pharmacokinetic data collected were the following 
measurements of the steady-state apparent volume of distribution (V). Also shown are previously 
collected data on children ages 3 to 12 years (A-19) and adults (A-20). Weights (W) of subjects are 
also shown. 


Infants Children Adults 


W (kg) V (liters) W (kg) V (liters) W (kg) V (liters) 


6.2 2.936 13 4.72 61 19.7 
7.5 3.616 14 5.23 80 23.7 
7.0 1.735 14 5.85 96 20.0 
7.1 2.557 15 4.17 75 19.5 
7.8 2.883 16 5.01 60 19.6 
8.2 2.318 17 5.81 68 21.5 
8.3 3.689 17 7.03 72.2 21.9 
8.5 4.133 17.5 6.62 87 30.9 
8.6 2.989 17 4.98 66.5 20.4 
8.8 3.500 17.5 6.45 

10.0 4.235 20 7.73 

10.0 4.804 23 7.67 

10.2 2.833 25 9.82 

10.3 4.068 37 14.40 

10.6 3.640 28 10.90 

107 4.067 47 15.40 

10.8 8.366 29 9.86 

11.0 4.614 37 14.40 

12.5 3.168 

13.1 4.158 


Source: Data provided courtesy of Dr. Klaus Stoeckel. 
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According to Fils-Aime et al. (A-21), epidemiologic surveys have found that alcoholism is the most 
common mental or substance abuse disorder among men in the United States. Fils-Aime and 
associates investigated the interrelationships of age at onset of excessive alcohol consumption, family 
history of alcoholism, psychiatric comorbidity, and cerebrospinal fluid (CSF) monoamine metabolite 
concentrations in abstinent, treatment-seeking alcoholics. Subjects were mostly white males 
classified as experiencing early (25 years or younger) or late (older than 25 years) onset of excessive 
alcohol consumption. Among the data collected were the following measurements on CSF trypto- 
phan (TRYPT) and 5-hydroxyindoleacetic acid (5-HIAA) concentrations (pmol/ml). 


Onset Onset 
1 = Early 1 = Early 
5-HIAA TRYPT 0 = Late 5-HIAA TRYPT 0 = Late 
57 3315 1 102 3181 1 
116 2599 0 51 2513 1 
81 3334 1 92 2764 1 
78 2505 0 104 3098 1 
206 3269 0 50 2900 1 
64 3543 1 93 4125 1 
123 3374 0 146 6081 1 
147 2345 1 96 2972 1 
102 2855 1 112 3962 0 
93 2972 1 23 4894 1 
128 3904 0 109 3543 1 
69 2564 1 80 2622 1 
20 8832 1 111 3012 1 
66 4894 0 85 2685 1 
90 6017 1 131 3059 0 
103 3143 0 58 3946 1 
68 3729 0 110 3356 0 
81 3150 1 80 3671 1 
143 3955 1 42 4155 1 
121 4288 1 80 1923 1 
149 3404 0 91 3589 1 
82 2547 1 102 3839 0 
100 3633 1 93 2627 0 
117 3309 1 98 3181 0 
41 3315 1 78 4428 0 
223 3418 0 152 3303 0 
96 2295 1 108 5386 1 
87 3232 0 102 3282 1 
96 3496 1 122 2754 1 
34 2656 1 81 4321 1 
98 4318 1 81 3386 1 
86 3510 0 99 3344 1 
118 3613 1 73 3789 1 
84 3117 1 163 2131 1 
99 3496 1 109 3030 0 
114 4612 1 90 4731 1 
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Onset Onset 
1 = Early 1 = Early 
5-HIAA TRYPT 0 = Late 5-HIAA TRYPT 0 = Late 
140 3051 1 110 4581 1 
74 3067 1 48 3292 0 
45 2782 1 T 4494 0 
51 5034 1 67 3453 1 
99 2564 1 92 3373 1 
54 4335 1 86 3787 0 
93 2596 1 101 3842 1 
50 2960 1 88 2882 1 
118 3916 0 38 2949 1 
96 2797 0 75 2248 0 
49 3699 1 35 3203 0 
133 2394 0 53 3248 1 
105 2495 0 TI 3455 0 
61 2496 1 179 4521 1 
197 2123 1 151 3240 1 
87 3320 0 57 3905 1 
50 3117 1 45 3642. 1 
109 3308 0 76 5233 0 
59 3280 1 46 4150 1 
107 3151 1 98 2579 1 
85 3955 0 84 3249 1 
156 3126 0 119 3381 0 
110 2913 0 41 4020 1 
81 3786 1 40 4569 1 
53 3616 1 149 3781 1 
64 3277 1 116 2346 1 
57 2656 1 76 3901 1 
29 4953 0 96 3822 1 
34 4340 1 


Source: Data provided courtesy of Dr. Markku Linnoila. 


The objective of a study by Abrahamsson et al. (A-22) was to investigate the anti-thrombotic effects 
of an inhibitor of the plasminogen activator inhibitor-1 (PAI-1) in rats given endotoxin. Experimental 
subjects were male Sprague-Dawley rats weighing between 300 and 400 grams. Among the data 
collected were the following measurements on PAI-1 activity and the lung !*°I-concentration in 
anesthetized rats given three drugs: 


Plasma PAI-1 25] Fibrin in the Lungs 
Drugs Activity (U/ml) (% of Ref. Sample) 
Endotoxin 127 158 
175 154 
161 118 
137 TI 
219 172 


(Continued ) 


592 


CHAPTER 11 REGRESSION ANALYSIS: SOME ADDITIONAL TECHNIQUES 


26. 


Plasma PAI-1 U5LFibrin in the Lungs 

Drugs Activity (U/ml) (% of Ref. Sample) 
260 277 
203 216 
195 169 
414 272 
244 192 
Endotoxin + PRAP = 1 low dose 107 49 
103 28 
248 187 
164 109 
176 96 
230 126 
184 148 
276 17 
201 97 
158 86 
Endotoxin 4- PRAP — 1 high dose 132 86 
130 24 
75 17 
140 41 
166 114 
194 110 
121 26 
111 53 
208 71 
211 90 


Source: Data provided courtesy of Dr. Tommy Abrahamsson. 


Pearse and Sylvester (A-23) conducted a study to determine the separate contributions of ischemia 
and extracorporeal perfusion to vascular injury occurring in isolated sheep lungs and to determine the 
oxygen dependence of this injury. Lungs were subjected to ischemia alone, extracorporeal perfusion 
alone, and both ischemia and extracorporeal perfusion. Among the data collected were the following 
Observations on change in pulmonary arterial pressure (mm Hg) and pulmonary vascular perme- 
ability assessed by estimation of the reflection coefficient for albumin in perfused lungs with and 
without preceding ischemia: 


Ischemic-Perfused Lungs Perfused Lungs 
Change in Change in 
Pulmonary Reflection Pulmonary Reflection 
Pressure Coefficient Pressure Coefficient 
8.0 0.220 34.0 0.693 
3.0 0.560 31.0 0.470 
10.0 0.550 4.0 0.651 


23.0 0.806 48.0 0.999 
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Ischemic-Perfused Lungs Perfused Lungs 

Change in Change in 
Pulmonary Reflection Pulmonary Reflection 
Pressure Coefficient Pressure Coefficient 
15.0 0.472 32.0 0.719 
43.0 0.759 27.0 0.902 
18.0 0.489 25.0 0.736 
27.0 0.546 25.0 0.718 
13.0 0.548 

0.0 0.467 


Source: Data provided courtesy of Dr. David B. Pearse. 


The purpose of a study by Balzamo et al. (A-24) was to investigate, in anesthetized rabbits, the effects 
of mechanical ventilation on the concentration of substance P (SP) measured by radioimmunoassay 
in nerves and muscles associated with ventilation and participating in the sensory innervation of the 
respiratory apparatus and heart. SP is a neurotransmitter located in primary sensory neurons in the 
central and autonomic nervous systems. Among the data collected were the following measures of SP 
concentration in cervical vagus nerves (X) and corresponding nodose ganglia (NG), right and left 


sides: 

SPXright SPNGright SPXleft SPNGleft 
0.6500 9.6300 3.3000 1.9300 
2.5600 3.7800 0.6200 2.8700 
1.1300 7.3900 0.9600 1.3100 
1.5500 3.2800 2.7000 5.6400 

35.9000 22.0000 4.5000 9.1000 

19.0000 22.8000 8.6000 8.0000 

13.6000 2.3000 7.0000 8.3000 
8.0000 15.8000 4.1000 4.7000 
7.4000 1.6000 5.5000 2.5000 
3.3000 11.6000 9.7000 8.0000 

19.8000 18.0000 13.8000 8.0000 
8.5000 6.2000 11.0000 17.2000 
5.4000 7.8000 11.9000 5.3000 

11.9000 16.9000 8.2000 10.6000 

47.7000 35.9000 3.9000 3.3000 

14.2000 10.2000 3.2000 1.9000 
2.9000 1.6000 2.7000 3.5000 
6.6000 3.7000 2.8000 2.5000 
3.7000 1.3000 


Source: Data provided courtesy of Dr. Yves Jammes. 


Scheeringa and Zeanah (A-25) examined the presence of posttraumatic stress disorder (PTSD), the 
severity of posttraumatic symptomatology, and the pattern of expression of symptom clusters in 
relation to six independent variables that may be salient to the development of a posttraumatic 
disorder in children under 48 months of age. The following data were collected during the course of 


the study. 
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Response Variables 


Predictor Variables 


Threat to 
Caregiver Reexp Numb Arous 


Wit./ 


Injury Exper. 


FrAgg 


Age Acute/Rept. 


Gender 


29. 
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Predictor Variables 


Response Variables 


Wit./ Threat to 


Gender Age Acute/Rept. Injury Exper. Caregiver Reexp Numb Arous  FrAgg 
Key: Gender 0 — male 
1 = female 
Age 0 = younger than 18 months at time of trauma 
1 — older than 18 months 
Acute/Rept. 0 — trauma was acute, single blow 
] = trauma was repealed or chronic 
Injury 0 — subject was not injured in the trauma 
1 = subject was physically injured in the trauma 
Wit./Exper. 0 = subject witnessed but did not directly experience trauma 


Threat to Caregiver 


] — subject directly experienced the trauma 
0 = caregiver was not threatened in the trauma 
1 = caregiver was threatened in the trauma 


Reexp — Reexperiencing cluster symptom count 

Numb — Numbing of responsiveness/avoidance cluster symptom count 
Arous — Hyperarousal cluster symptom count 

FrAgg — New fears/aggression cluster symptom count 


Source: Data provided courtesy of Dr. Michael S. Scheeringa. 


One of the objectives of a study by Mulloy and McNicholas (A-26) was to compare ventilation and 
gas exchange during sleep and exercise in chronic obstructive pulmonary disease (COPD). The 
investigators wished also to determine whether exercise studies could aid in the prediction of 
nocturnal desaturation in COPD. Subjects (13 male, 6 female) were ambulatory patients attending an 
outpatient respiratory clinic. The mean age of the patients, all of whom had severe, stable COPD, was 
64.8 years with a standard deviation of 5.2. Among the data collected were measurements on the 
following variables: 


Lowest Mean Lowest Fall 


Age PaO, PaCO, FEV, Ex. Sleep Sleep Sleep 
(years) BMI (mmHg) (mmHg) (% Predicted) Sao,” Sao,” Sao,” Sao,” 
67 23.46 52.5 54 22 74 70.6 56 29.6 
62 25.31 57.75 49.575 19 82 85.49 76 11.66 
68 23.11 72 43.8 41 95 88.72 82 11.1 
61 25.15 72 47.4 38 88 91.11 76 18.45 
70 24.54 78 40.05 40 88 92.86 92 0.8 
71 25.47 63.75 45.375 3l 85 88.95 80 13 

60 19.49 80.25 42.15 28 91 94.78 90 4 

57 21.37 84.75 40.2 20 91 93.72 89 5.8 
69 25.78 68.25 43.8 32 85 90.91 79 13 

57 22.13 83.25 43.725 20 88 94.39 86 9.5 
74 26.714 57.75 51 33 75 89.89 80 14.11 
63 19.07 78 44.175 36 81 93.95 82 13 

64 19.61 90.75 40.35 27 90 95.07 92 4 

73 30.30 69.75 38.85 53 87 90 76 18 


(Continued ) 
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Lowest Mean Lowest Fall 
Age PaO, PaCO, FEV, Ex. Sleep Sleep Sleep 
(years) BMI (mmHg) (mmHg) (% Predicted) Sao? | бао» Sao?" Sao?" 


63 26.12 51.75 46.8 39 67 69.31 46 34.9 
62 21.71 72 41.1 27 88 87.95 72 22 
67 24.75 84.75 40.575 45 87 92.95 90 2.17 
57 25.98 84.75 40.05 35 94 93.4 86 8.45 
66 32.00 51.75 53.175 30 83 80.17 71 16 


“Treated as dependent variable in the authors’ analyses. ВМІ = body mass index; Pao, = arterial oxygen 
tension: Paco, = arterial carbon dioxide pressure; FEV, = forced expiratory volume in 1 second; Sao; = arterial 
oxygen saturation. 

Source: Data provided courtesy of Dr. Eithne Mulloy. 


Exercises for Use with the Large Data Sets Available on the Following Website: 
www.wiley.com/college/daniel 


The goal of a study by Gyurcsik et al. (A-27) was to examine the usefulness of aquatic exercise- 
related goals, task self-efficacy, and scheduling self-efficacy for predicting aquatic exercise attend- 
ance by individuals with arthritis. The researchers collected data on 142 subjects participating in 
Arthritis Foundation Aquatics Programs. The outcome variable was the percentage of sessions 
attended over an 8-week period (ATTEND). The following predictor variables are all centered values. 
Thus, for each participant, the mean for all participants is subtracted from the individual score. The 
variables are: 


GOALDIFF—higher values indicate setting goals of higher participation. 

GOALSPEC—higher values indicate higher specificity of goals related to aquatic exercise. 

INTER—interaction of GOALDIFF and GOALSPEC. 

TSE—higher values indicate participants’ confidence in their abilities to attend aquatic classes. 

SSE— higher values indicate participants’ confidence in their abilities to perform eight tasks related 
to scheduling exercise into their daily routine for 8 weeks. 


MONTHS—montbhs of participation in aquatic exercise prior to start of study. 


With the data set AQUATICS, perform a multiple regression to predict ATTEND with each of the 
above variables. What is the multiple correlation coefficient? What variables are significant in 
predicting ATTEND? What are your conclusions? 


Rodehorst (A-28) conducted a prospective study of 212 rural elementary school teachers. The 
main outcome variable was the teachers” intent to manage children demonstrating symptoms of 
asthma in their classrooms. This variable was measured with a single-item question that used a 
seven-point Likert scale (INTENT, with possible responses of 1 — extremely probable to 7 — 
extremely improbable). Rodehorst used the following variables as independent variables to predict 
INTENT: 


SS — Social Support. Scores range from 7 to 49, with higher scores indicating higher perceived 
social support for managing children with asthma in a school setting. 

ATT — Attitude. Scores range from 15 to 90, with higher scores indicating more favorable attitudes 
toward asthma. 
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KNOW = Knowledge. Scores range from 0 to 24, with higher scores indicating higher general 
knowledge about asthma. 


CHILD =Number of children with asthma the teacher has had in his or her class during his or her 
entire teaching career. 


SE — Self-efficacy. Scores range from 12 to 60, with higher scores indicating higher self-efficacy 
for managing children with asthma in the school setting. 


YRS = Years of teaching experience. 


With the data TEACHERS, use stepwise regression analysis to select the most useful variables to 
include in a model for predicting INTENT. 


Refer to the weight loss data on 588 cancer patients and 600 healthy controls (WGTLOSS). Weight 
loss among cancer patients is a well-known phenomenon. Of interest to clinicians is the role played in 
the process by metabolic abnormalities. One investigation into the relationships among these 
variables yielded data on whole-body protein turnover (Y) and percentage of ideal body weight 
for height (X). Subjects were lung cancer patients and healthy controls of the same age. Select a 
simple random sample of size 15 from each group and do the following: 


(a) Draw a scatter diagram of the sample data using different symbols for each of the two groups. 
(b) Use dummy variable coding to analyze these data. 
(c) Plot the two regression lines on the scatter diagram. May one conclude that the two sampled 


populations differ with respect to mean protein turnover when percentage of ideal weight is taken 
into account? 


May one conclude that there is interaction between health status and percentage of ideal body weight? 
Prepare a verbal interpretation of the results of your analysis and compare your results with those of 
your classmates. 
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THE CHI-SQUARE 
DISTRIBUTION AND THE ANALYSIS 
OF FREQUENCIES 


CHAPTER OVERVIEW 


This chapter explores techniques that are commonly used in the analysis of 
count or frequency data. Uses of the chi-square distribution, which was 
mentioned briefly in Chapter 6, are discussed and illustrated in greater detail. 
Additionally, statistical techniques often used in epidemiological studies are 
introduced and demonstrated by means of examples. 


TOPICS 


12.1 INTRODUCTION 

12.2 THE MATHEMATICAL PROPERTIES OF THE CHI-SQUARE DISTRIBUTION 
12.3 TESTS OF GOODNESS-OF-FIT 

12.4 TESTS OF INDEPENDENCE 

12.5 TESTS OF HOMOGENEITY 

12.6 THE FISHER EXACT TEST 

12.7 RELATIVE RISK, ODDS RATIO, AND THE MANTEL-HAENSZEL STATISTIC 
12.8 SUMMARY 


LEARNING OUTCOMES 


After studying this chapter, the student will 


ПЕ 
2. 
3. 
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understand the mathematical properties of the chi-square distribution. 
be able to use the chi-square distribution for goodness-of-fit tests. 


be able to construct and use contingency tables to test independence 
and homogeneity. 


be able to apply Fisher's exact test for 2 x 2 tables. 


understand how to calculate and interpret the epidemiological concepts of relative 
risk, odds ratios, and the Mantel-Haenszel statistic. 
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12.1 INTRODUCTION 


In the chapters on estimation and hypothesis testing, brief mention is made of the chi- 
square distribution in the construction of confidence intervals for, and the testing of, 
hypotheses concerning a population variance. This distribution, which is one of the most 
widely used distributions in statistical applications, has many other uses. Some of the more 
common ones are presented in this chapter along with a more complete description of the 
distribution itself, which follows in the next section. 

The chi-square distribution is the most frequently employed statistical technique for 
the analysis of count or frequency data. For example, we may know for a sample of 
hospitalized patients how many are male and how many are female. For the same sample 
we may also know how many have private insurance coverage, how many have Medicare 
insurance, and how many are on Medicaid assistance. We may wish to know, for the 
population from which the sample was drawn, if the type of insurance coverage differs 
according to gender. For another sample of patients, we may have frequencies for each 
diagnostic category represented and for each geographic area represented. We might want 
to know if, in the population from which the same was drawn, there is a relationship 
between area of residence and diagnosis. We will learn how to use chi-square analysis to 
answer these types of questions. 

There are other statistical techniques that may be used to analyze frequency data in 
an effort to answer other types of questions. In this chapter we will also learn about these 
techniques. 


12.2 THE MATHEMATICAL PROPERTIES 
OF THE CHI-SQUARE DISTRIBUTION 


The chi-square distribution may be derived from normal distributions. Suppose that from a 
normally distributed random variable Y with mean и and variance o? we randomly and 
independently select samples of size n — 1. Each value selected may be transformed to the 
standard normal variable z by the familiar formula 


(12.2.1) 


Each value of z may be squared to obtain 22. When we investigate the sampling distri- 
bution of z?, we find that it follows a chi-square distribution with 1 degree of freedom. 
That is, 


Now suppose that we randomly and independently select samples of size n — 2 from the 
normally distributed population of Y values. Within each sample we may transform each 
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value of y to the standard normal variable z and square as before. If the resulting values of z 
for each sample are added, we may designate this sum by 


2 YIT UAN? (MM MY 3,2 
X» = (A ) M ) а. 


since it follows the chi-square distribution with 2 degrees of freedom, the number ої 
independent squared terms that are added together. 

The procedure may be repeated for any sample size n. The sum of the resulting 2 
values in each case will be distributed as chi-square with n degrees of freedom. In general, 
then, 


Ха) ВА (12.2.2) 


follows the chi-square distribution with n degrees of freedom. The mathematical form of 
the chi-square distribution is as follows: 


1 1 
E а (872) te 2) 
f(u) к gn e , u»0 (12.2.3) 
2 ! 
where e is the irrational number 2.71828 . . . and k is the number of degrees of freedom. 


The variate u is usually designated by the Greek letter chi (x) and, hence, the distribution is 
called the chi-square distribution. As we pointed out in Chapter 6, the chi-square 
distribution has been tabulated in Appendix Table F. Further use of the table is demon- 
strated as the need arises in succeeding sections. 

The mean and variance of the chi-square distribution are k and 2k, respectively. The 
modal value of the distribution is k — 2 for values of k greater than or equal to 2 and is zero 
for k — 1. 

The shapes of the chi-square distributions for several values of k are shown in Figure 
6.9.1. We observe in this figure that the shapes for k — 1 and k — 2 are quite different from 
the general shape of the distribution for k > 2. We also see from this figure that chi-square 
assumes values between 0 and infinity. It cannot take on negative values, since it is the sum 
of values that have been squared. A final characteristic of the chi-square distribution worth 
noting is that the sum of two or more independent chi-square variables also follows a 
chi-square distribution. 


Types of Chi-Square Tests As already noted, we make use of the chi-square 
distribution in this chapter in testing hypotheses where the data available for analysis are 
in the form of frequencies. These hypothesis testing procedures are discussed under the 
topics of tests of goodness-of-fit, tests of independence, and tests of homogeneity. We will 
discover that, in a sense, all of the chi-square tests that we employ may be thought of as 
goodness-of-fit tests, in that they test the goodness-of-fit of observed frequencies to 
frequencies that one would expect if the data were generated under some particular theory 
or hypothesis. We, however, reserve the phrase “goodness-of-fit” for use in a more 
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restricted sense. We use itto refer to a comparison of a sample distribution to some theoretical 
distribution that it is assumed describes the population from which the sample came. The 
justification of our use of the distribution in these situations is due to Karl Pearson (1), who 
showed that the chi-square distribution may be used as a test of the agreement between 
observation and hypothesis whenever the data are in the form of frequencies. An extensive 
treatment of the chi-square distribution is to be found in the book by Lancaster (2). Nikulin 
and Greenwood (3) offer practical advice for conducting chi-square tests. 


Observed Versus Expected Frequencies The chi-square statistic is most 
appropriate for use with categorical variables, such as marital status, whose values are 
the categories married, single, widowed, and divorced. The quantitative data used in 
the computation of the test statistic are the frequencies associated with each category of the 
one or more variables under study. There are two sets of frequencies with which we are 
concerned, observed frequencies and expected frequencies. The observed frequencies 
are the number of subjects or objects in our sample that fall into the various categories of 
the variable of interest. For example, if we have a sample of 100 hospital patients, we may 
observe that 50 are married, 30 are single, 15 are widowed, and 5 are divorced. Expected 
frequencies are the number of subjects or objects in our sample that we would expect to 
Observe if some null hypothesis about the variable is true. For example, our null hypothesis 
might be that the four categories of marital status are equally represented in the population 
from which we drew our sample. In that case we would expect our sample to contain 25 
married, 25 single, 25 widowed, and 25 divorced patients. 


The Chi-Square Test Statistic The test statistic for the chi-square tests we 
discuss in this chapter is 


2 
х = y (One da) (12.2.4) 


When the null hypothesis is true, X? is distributed approximately as X? with k — r 
degrees of freedom. In determining the degrees of freedom, k is equal to the number of 
groups for which observed and expected frequencies are available, and r is the number of 
restrictions or constraints imposed on the given comparison. A restriction is imposed when 
we force the sum of the expected frequencies to equal the sum of the observed frequencies, 
and an additional restriction is imposed for each parameter that is estimated from the 
sample. 

In Equation 12.2.4, О; 15 the observed frequency for the ith category of the variable of 
interest, and Е; is the expected frequency (given that Но is true) for the ith category. 

The quantity X? is a measure of the extent to which, in a given situation, pairs of 
observed and expected frequencies agree. As we will see, the nature of X? is such that when 
there is close agreement between observed and expected frequencies it is small, and when 
the agreement is poor it is large. Consequently, only a sufficiently large value of X? will 
cause rejection of the null hypothesis. 

If there is perfect agreement between the observed frequencies and the frequencies 
that one would expect, given that Но is true, the term O, — E; in Equation 12.2.4 will be 
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equal to zero for each pair of observed and expected frequencies. Such a result would yield 
a value of X? equal to zero, and we would be unable to reject Но. 

When there is disagreement between observed frequencies and the frequencies one 
would expect given that Но is true, at least one of the O; — E; terms in Equation 12.2.4 will 
be а nonzero number. In general, the poorer the agreement between the О; and the Е, the 
greater or the more frequent will be these nonzero values. As noted previously, if the 
agreement between the O; and the E; is sufficiently poor (resulting in a sufficiently large X? 
value,) we will be able to reject Ho. 

When there is disagreement between a pair of observed and expected frequencies, the 
difference may be either positive or negative, depending on which of the two frequencies is 
the larger. Since the measure of agreement, X?, is a sum of component quantities whose 
magnitudes depend on the difference O; — E;, positive and negative differences must be 
given equal weight. This is achieved by squaring each O; — E; difference. Dividing the 
squared differences by the appropriate expected frequency converts the quantity to a term 
that is measured in original units. Adding these individual (O; — Е y / Ej terms yields X^ 
summary statistic that reflects the extent of the overall agreement between observed and 
expected frequencies. 


The Decision Rule The quantity У (0; — E;)?/E;] will be small if the observed 
and expected frequencies are close together and will be large if the differences are large. 

The computed value of X? is compared with the tabulated value of x? with k—r 
degrees of freedom. The decision rule, then, is: Reject Ho if X is greater than or equal to the 
tabulated x? for the chosen value of o. 


Small Expected Frequencies Frequently in applications of the chi-square test 
the expected frequency for one or more categories will be small, perhaps much less than 1. 
In the literature the point is frequently made that the approximation of X? to x? is not 
strictly valid when some of the expected frequencies are small. There is disagreement 
among writers, however, over what size expected frequencies are allowable before making 
some adjustment or abandoning X. in favor of some alternative test. Some writers, 
especially the earlier ones, suggest lower limits of 10, whereas others suggest that all 
expected frequencies should be no less than 5. Cochran (4,5), suggests that for goodness- 
of-fit tests of unimodal distributions (such as the normal) the minimum expected 
frequency can be as low as 1. If, in practice, one encounters one or more expected 
frequencies less than 1, adjacent categories may be combined to achieve the suggested 
minimum. Combining reduces the number of categories and, therefore, the number of 
degrees of freedom. Cochran's suggestions appear to have been followed extensively by 
practitioners in recent years. 


12.3 TESTS OF GOODNESS-OF-FIT 


As we have pointed out, a goodness-of-fit test is appropriate when one wishes to decide if 
an observed distribution of frequencies is incompatible with some preconceived or 
hypothesized distribution. 
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We may, for example, wish to determine whether or not a sample of observed values 
of some random variable is compatible with the hypothesis that it was drawn from a 
population of values that is normally distributed. The procedure for reaching a decision 
consists of placing the values into mutually exclusive categories or class intervals and 
noting the frequency of occurrence of values in each category. We then make use of our 
knowledge of normal distributions to determine the frequencies for each category that one 
could expect if the sample had come from a normal distribution. If the discrepancy is of 
such magnitude that it could have come about due to chance, we conclude that the sample 
may have come from a normal distribution. In a similar manner, tests of goodness-of-fit 
may be carried out in cases where the hypothesized distribution is the binomial, the 
Poisson, or any other distribution. Let us illustrate in more detail with some examples of 
tests of hypotheses of goodness-of-fit. 


EXAMPLE 12.3.1 The Normal Distribution 


Cranor and Christensen (A-1) conducted a study to assess short-term clinical, economic, 
and humanistic outcomes of pharmaceutical care services for patients with diabetes in 
community pharmacies. For 47 of the subjects in the study, cholesterol levels are 
summarized in Table 12.3.1. 

We wish to know whether these data provide sufficient evidence to indicate that the 
sample did not come from a normally distributed population. Let a = .05 


Solution: 


1. Data. See Table 12.3.1. 


2. Assumptions. We assume that the sample available for analysis is a 
simple random sample. 


TABLE 12.3.1 Cholesterol Levels as 
Described in Example 12.3.1 


Cholesterol 
Level (mg/dl) Number of Subjects 


100.0-124.9 
125.0-149.9 
150.0-174.9 
175.0-199.9 
200.0-224.9 
225.0-249.9 
250.0-274.9 
275.0-299.9 3 


= 
BBD со соо = 


Source: Data provided courtesy of Carole W. Cranor, and 
Dale B. Christensen, “The Asheville Project: Short-Term 
Outcomes of a Community Pharmacy Diabetes Care 
Program,” Journal of the American Pharmaceutical 
Association, 43 (2003), 149-159. 
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3. Hypotheses. 
Ho: In the population from which the sample was drawn, cholesterol 
levels are normally distributed. 
Ha: The sampled population is not normally distributed. 


4. Test statistic. The test statistic is 


k 2 
2 (О; — Ei) 
X > TE | 


5. Distribution of test statistic. If Но is true, the test statistic is distributed 
approximately as chi-square with k — r degrees of freedom. The values 
of k and r will be determined later. 


6. Decision rule. We will reject Но if the computed value of X? is equal to 
or greater than the critical value of chi-square. 


7. Calculation of test statistic. Since the mean and variance of the 
hypothesized distribution are not specified, the sample data must be 
used to estimate them. These parameters, or their estimates, will be 
needed to compute the frequency that would be expected in each class 
interval when the null hypothesis is true. The mean and standard 
deviation computed from the grouped data of Table 12.3.1 are 


x — 198.67 
5 = 41.31 


As the next step in the analysis, we must obtain for each class 
interval the frequency of occurrence of values that we would expect when 
the null hypothesis is true, that is, if the sample were, in fact, drawn from 
a normally distributed population of values. To do this, we first determine 
the expected relative frequency of occurrence of values for each class 
interval and then multiply these expected relative frequencies by the total 
number of values to obtain the expected number of values for each 
interval. 


The Expected Relative Frequencies 


It will be recalled from our study of the normal distribution that the relative frequency of 
occurrence of values equal to or less than some specified value, say, xo, of the normally 
distributed random variable X is equivalent to the area under the curve and to the left of хо 
as represented by the shaded area in Figure 12.3.1. We obtain the numerical value of this 
area by converting хо to a standard normal deviation by the formula zo = (хо — и) /о and 
finding the appropriate value in Appendix Table D. We use this procedure to obtain the 
expected relative frequencies corresponding to each of the class intervals in Table 12.3.1. 
We estimate и and o with x and s as computed from the grouped sample data. The first step 
consists of obtaining z values corresponding to the lower limit of each class interval. The 
area between two successive z values will give the expected relative frequency of 
occurrence of values for the corresponding class interval. 
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Xo x 


FIGURE 12.3.1 A normal distribution showing the relative frequency of occurrence of values 
less than or equal to хо. The shaded area represents the relative frequency of occurrence of values 
equal to or less than хо. 


For example, to obtain the expected relative frequency of occurrence of values in the 
interval 100.0 to 124.9 we proceed as follows: 


100.0 — 198.67 
The z value corresponding to X = 100.0 15 z = 2 x ще 2.39 

125.0 — 198.67 
The z value corresponding to X = 125.0isz = 2 - x ше 178 


In Appendix Table D we find that the area to the left of —2.39 is .0084, and the area to 
the left of —1.78 is .0375. The area between —1.78 and —2.39 is equal to 
.0375 — .0084 — .0291, which is equal to the expected relative frequency of occurrence 
of cholesterol levels within the interval 100.0 to 124.9. This tells us that if the null 
hypothesis is true, that is, if the cholesterol levels are normally distributed, we should 
expect 2.91 percent of the values in our sample to be between 100.0 and 124.9. When we 
multiply our total sample size, 47, by .0291 we find the expected frequency for the interval 
to be 1.4. Similar calculations will give the expected frequencies for the other intervals as 
shown in Table 12.3.2. 


TABLE 12.3.2 Class Intervals and Expected Frequencies for 
Example 12.3.1 


z(x; — X)/s 

At Lower Limit Expected Relative Expected 
Class Interval of Interval Frequency Frequency 
« 100 .0084 MIL 
100.0-124.9 —2.39 .0291 1.4 
125.0-149.9 —1.78 .0815 3.8 
150.0-174.9 —1.18 .1653 7.8 
175.0-199.9 —.57 2277 10.7 
200.0-224.9 .03 .2269 10.7 
225.0-249.9 .64 .1536 7.2 
250.0-274.9 1.24 .0753 3.5 
275.0-299.9 1.85 .0251 1.2 his 
300.0 and greater 2.45 .0071 3 
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Comparing Observed and Expected Frequencies 


We are now interested in examining the magnitudes of the discrepancies between the 
observed frequencies and the expected frequencies, since we note that the two sets of 
frequencies do not agree. We know that even if our sample were drawn from a normal 
distribution of values, sampling variability alone would make it highly unlikely that the 
observed and expected frequencies would agree perfectly. We wonder, then, if the 
discrepancies between the observed and expected frequencies are small enough that we 
feel it reasonable that they could have occurred by chance alone, when the null hypothesis 
is true. If they are of this magnitude, we will be unwilling to reject the null hypothesis that 
the sample came from a normally distributed population. 

If the discrepancies are so large that it does not seem reasonable that they could have 
occurred by chance alone when the null hypothesis is true, we will want to reject the null 
hypothesis. The criterion against which we judge whether the discrepancies are "large" or 
"small" is provided by the chi-square distribution. 

The observed and expected frequencies along with each value of (O; — Е)? /E; are 
shown in Table 12.3.3. The first entry in the last column, for example, is computed from 
(1— 1.8)2/1.8 = 356. The other values of (0; — E¡)?/E; are computed in a similar 
manner. 

From Table 12.3.3 we see that X? = У(О; — Е) /Е] = 10.566. The appropriate 
degrees of freedom are 8 (the number of groups or class intervals) —3 (for the three 
restrictions: making У) E; = 510), and estimating и and с from the sample data) = 5. 


8. Statistical decision. When we compare X? = 10.566 with values of x? in 
Appendix Table F, we see that it is less than as = 11.070, so that, at the 
.05 level of significance, we cannot reject the null hypothesis that the 
sample came from a normally distributed population. 


TABLE 12.3.3 Observed and Expected Frequencies and 
(O; — E;?/E; for Example 12.3.1 


Observed Expected 
Frequency Frequency 
Class Interval (0) (E) (0; — ЕР? /Е; 
< 100 0 4 
1.8 .356 
100.0-124.9 1 1.4 
125.0-149.9 3 3.8 .168 
150.0-174.9 8 7.8 .005 
175.0-199.9 18 10.7 4.980 
200.0-224.9 6 10.7 2.064 
225.0-249.9 4 7.2 1.422 
250.0-274.9 4 3.5 .071 
275.0-299.9 3 1.2 
1.5 1.500 
300.0 and 0 3 
greater 


Total 47 47 10.566 
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9. Conclusion. We conclude that in the sampled population, cholesterol 
levels may follow a normal distribution. 

10. p value. Since 11.070 > 10.566 > 9.236, .05 « p < .10. In other words, 
the probability of obtaining a value of X? as large as 10.566, when the null 
hypothesis is true, is between .05 and .10. Thus we conclude that such an 
event is not sufficiently rare to reject the null hypothesis that the data come 
from a normal distribution. A 


Sometimes the parameters are specified in the null hypothesis. It should be noted 
that had the mean and variance of the population been specified as part of the null 
hypothesis in Example 12.3.1, we would not have had to estimate them from the sample 
and our degrees of freedom would have been 8 — 1 — 7. 


Alternatives Although one frequently encounters in the literature the use of chi- 
square to test for normality, it is not the most appropriate test to use when the hypothesized 
distribution is continuous. The Kolmogorov-Smirnov test, described in Chapter 13, was 
especially designed for goodness-of-fit tests involving continuous distributions. 


EXAMPLE 12.3.2 The Binomial Distribution 


In a study designed to determine patient acceptance of a new pain reliever, 100 physicians 
each selected a sample of 25 patients to participate in the study. Each patient, after trying 
the new pain reliever for a specified period of time, was asked whether it was preferable to 
the pain reliever used regularly in the past. 

The results of the study are shown in Table 12.3.4. 


TABLE 12.3.4 Results of Study Described in Example 12.3.2 


Number of 
Number of Patients Doctors Total Number of Patients 
Out of 25 Preferring Reporting this Preferring New Pain 
New Pain Reliever Number Reliever by Doctor 
0 5 0 
1 6 6 
2 8 16 
3 10 30 
4 10 40 
5 15 75 
6 17 102 
7 10 70 
8 10 80 
9 9 81 
10 or more 0 0 


Total 100 500 
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We are interested in determining whether or not these data are compatible with the 
hypothesis that they were drawn from a population that follows a binomial distribution. 
Again, we employ a chi-square goodness-of-fit test. 


Solution: 


Since the binomial parameter, p, is not specified, it must be estimated from 
the sample data. A total of 500 patients out of the 2500 patients participating 
in the study said they preferred the new pain reliever, so that our point 
estimate of p is p — 500/2500 — .20. The expected relative frequencies can 
be obtained by evaluating the binomial function 


F(x) = 362) (8)77 


for x = 0,1,...,25. For example, to find the probability that out of a sample 
of 25 patients none would prefer the new pain reliever, when in the total 
population the true proportion preferring the new pain reliever is .2, we would 
evaluate 


f(0) == icono) Ao ТР 


This can be done most easily by consulting Appendix Table B, where we see 
that P(X — 0) — .0038. The relative frequency of occurrence of samples of 
size 25 in which no patients prefer the new pain reliever is .0038. To obtain 
the corresponding expected frequency, we multiply .0038 by 100 to get .38. 
Similar calculations yield the remaining expected frequencies, which, along 
with the observed frequencies, are shown in Table 12.3.5. We see in this table 


TABLE 12.3.5 Calculations for Example 12.3.2 


Number of 
Number of Doctors Reporting 
Patients Out of 25 This Number Expected 
Preferring New Pain (Observed Relative Expected 
Reliever Frequency, О) Frequency Frequency E; 
0 5 .0038 .38 
1 о .0236 NI 
2 8 .0708 7.08 
3 10 .1358 13.58 
4 10 .1867 18.67 
5 15 .1960 19.60 
6 17 .1633 16.33 
7 10 .1109 11.09 
8 10 .0623 6.23 
9 9 .0295 2.95 
10 or more 0 .0173 1.73 
Total 100 1.0000 100.00 
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that the first expected frequency is less than 1, so that we follow Cochran's 
suggestion and combine this group with the second group. When we do this, 
all the expected frequencies are greater than 1. 

From the data, we compute 


11—2.74?  (8— 7.08)? (0— 1.73)? 


x2 — oe 
2.74 + 7.08 BINE 1.73 


— 47.624 


The appropriate degrees of freedom are 10 (the number of groups left 
after combining the first two) less 2, or 8. One degree of freedom is lost 
because we force the total of the expected frequencies to equal the total 
observed frequencies, and one degree of freedom is sacrificed because we 
estimated p from the sample data. 

We compare our computed X? with the tabulated x^ with 8 degrees of 
freedom and find that it is significant at the .005 level of significance; that is, 
p « .005. We reject the null hypothesis that the data came from a binomial 
distribution. и 


EXAMPLE 12.3.3 The Poisson Distribution 


A hospital administrator wishes to test the null hypothesis that emergency admissions 
follow a Poisson distribution with à = 3. Suppose that over a period of 90 days the numbers 
of emergency admissions were as shown in Table 12.3.6. 


TABLE 12.3.6 Number of Emergency Admissions to a Hospital During a 
90-Day Period 


Day 


<3; Cae IX тый 
ш io о осо со мч DA Ь UOUN |= 


EE 
ть 


Emergency Emergency Emergency Emergency 
Admissions Day Admissions Day Admissions Day Admissions 
2 24 5 47 4 70 3 
3 25 3 48 2 71 5 
4 26 2 49 2 72 4 
5 27 4 50 3 73 1 
3 28 4 51 4 74 1 
2 29 3 52 2 75 6 
3 30 5 53 3 76 3 
0 31 1 54 1 77 3 
1 32 3 55 2 78 5 
0 33 2 56 3 79 2 
1 34 4 57 2 80 1 
0 35 2 58 5 81 7 
6 36 5 59 2 82 7 
4 37 0 60 7 83 1 
4 38 6 61 8 84 5 
4 39 4 62 3 85 1 


(Continued) 


612 


CHAPTER 12 THE CHI-SQUARE DISTRIBUTION AND THE ANALYSIS OF FREQUENCIES 


Emergency Emergency Emergency Emergency 
Day Admissions Day Admissions Day Admissions Day Admissions 
17 3 40 4 63 1 86 4 
18 4 41 5 64 3 87 4 
19 3 42 1 65 1 88 9 
20 3 43 3 66 0 89 2 
21 3 44 1 67 3 90 3 
22 4 45 2 68 2 
23 3 46 3 69 1 


The data of Table 12.3.6 are summarized in Table 12.3.7. 


Solution: To obtain the expected frequencies we first obtain the expected relative 
frequencies by evaluating the Poisson function given by Equation 4.4.1 for 
each entry in the left-hand column of Table 12.3.7. For example, the first 
expected relative frequency is obtained by evaluating 


e 230 


We may use Appendix Table C to find this and all the other expected rel- 
ative frequencies that we need. Each of the expected relative frequencies 


TABLE 12.3.7 Summary of Data Presented 
in Table 12.3.6 


Number of 
Number of Days This Number 
Emergency Admissions of Emergency 
in a Day Admissions Occurred 


0 
1 
2 
3 
4 
5 
6 
7 
8 
9 
0 


10 or more 


Total 90 
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TABLE 12.3.8 Observed and Expected Frequencies and Components 
of X? for Example 12.3.3 


Number of 

Number of Days this Expected 

Emergency Number Relative Expected (0; — E; 

Admissions Occurred, O; Frequency Frequency E; 
0 5 .050 4.50 .056 
1 14 .149 13.41 .026 
2 15 .224 20.16 1.321 
3 23 .224 20.16 .400 
4 16 .168 15.12 .051 
5 9 .101 9.09 .001 
6 3 .050 4.50 .500 
7 3 .022 1.98 .525 
8 1 .008 72 
9 152 .003 .27 51.08 .784 

10 or more 0 .001 .09 

Total 90 1.000 90.00 3.664 


is multiplied by 90 to obtain the corresponding expected frequencies. 
These values along with the observed and expected frequencies and the 
components of xe (0; — Ej) JE, are displayed in Table 12.3.8, in which we 
see that 


зай - 4.50)? 2-108) 
У CORES AE AO a пн 


x= 
Е; 4.50 1.08 


We also note that the last three expected frequencies are less than 1, so that 
they must be combined to avoid having any expected frequencies less than 1. 
This means that we have only nine effective categories for computing degrees 
of freedom. Since the parameter, A, was specified in the null hypothesis, we 
do not lose a degree of freedom for reasons of estimation, so that the 
appropriate degrees of freedom are 9 — 1 — 8. By consulting Appendix 
Table Е, we find that the critical value of x° for 8 degrees of freedom and 
а = 05 is 15.507, so that we cannot reject the null hypothesis at the .05 level, 
or for that matter any reasonable level, of significance (p > .10). We 
conclude, therefore, that emergency admissions at this hospital may follow 
a Poisson distribution with A = 3. At least the observed data do not cast any 
doubt on that hypothesis. 

If the parameter A has to be estimated from sample data, the estimate is 
obtained by multiplying each value x by its frequency, summing these 
products, and dividing the total by the sum of the frequencies. ш 
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EXAMPLE 12.3.4 The Uniform Distribution 


The flu season in southern Nevada for 2005-2006 ran from December to April, the 
coldest months of the year. The Southern Nevada Health District reported the numbers 
of vaccine-preventable influenza cases shown in Table 12.3.9. We are interested in 
knowing whether the numbers of flu cases in the district are equally distributed among 
the five flu season months. That is, we wish to know if flu cases follow a uniform 
distribution. 


Solution: 


1. Data. See Table 12.3.9. 


2. Assumptions. We assume that the reported cases of flu constitute a 
simple random sample of cases of flu that occurred in the district. 


3. Hypotheses. 
Ho: Flu cases in southern Nevada are uniformly distributed over the five 
flu season months. 
На: Flu cases in southern Nevada are not uniformly distributed over the 
five flu season months. 
Let a = .01. 


4. Test statistic. The test statistic is 


5. Distribution of test statistic. If Но is true, X? is distributed approxi- 
mately as х2 with (5 — 1) = 4 degrees of freedom. 


6. Decision rule. Reject Но if the computed value of X? is equal to or 
greater than 13.277. 


TABLE 12.3.9 Reported Vaccine-Preventable 
Influenza Cases from Southern Nevada, 
December 2005-April 2006 


Number of 
Reported Cases 

Month of Influenza 
December 2005 62 
January 2006 84 
February 2006 17 
March 2006 16 
April 2006 21 
Total 200 


Source: http://www.southernnevadahealthdistrict.org/ 
epidemiology/disease statistics.htm. 
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Chart of Observed and Expected Values 
90 1 Expected 
80 + m Observed 
70 + 
60 + 
50 + 
40 + 
30 4 
20 + 
10 4 


0 
Category 


Chi-Square Goodness-of-Fit Test for Observed Counts in Variable: C1 


Test Contribution 


Category Observed Proportion Expected to Chi-Sq 
1 62 0.22 40 12.100 


2 84 40 48.400 
3 17 40 13.225 
4 16 40 14.400 
5 21 40 9.025 


0 
0. 
0. 
0 


Chi-Sq P-Value 
97.15 0.000 


FIGURE 12.3.2 MINITAB output for Example 12.3.4. 


7. Calculation of test statistic. If the null hypothesis is true, we would 
expect to observe 200/5 — 40 cases per month. Figure 12.3.2 shows the 
computer printout obtained from MINITAB. The bar graph shows the 
observed and expected frequencies per month. The chi-square table 
provides the observed frequencies, the expected frequencies based on a 
uniform distribution, and the individual chi-square contribution for each 
test value. 

8. Statistical decision. Since 97.15, the computed value of X’, is greater 
than 13.277, we reject, based on these data, the null hypothesis of a 
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9. 


10. 


uniform distribution of flu cases during the flu season in southern 
Nevada. 

Conclusion. We conclude that the occurrence of flu cases does not 
follow a uniform distribution. 


p value. From the MINITAB output we see that p = .000 (i.e., < .001). 
и 


EXAMPLE 12.3.5 


A certain human trait is thought to be inherited according to the ratio 1:2:1 for homozygous 
dominant, heterozygous, and homozygous recessive. An examination of a simple random 
sample of 200 individuals yielded the following distribution of the trait: dominant, 43; 
heterozygous, 125; and recessive, 32. We wish to know if these data provide sufficient 
evidence to cast doubt on the belief about the distribution of the trait. 


Solution: 


10. 


. Data. See statement of the example. 


. Assumptions. We assume that the data meet the requirements for the 


application of the chi-square goodness-of-fit test. 


. Hypotheses. 


Ho: The trait is distributed according to the ratio 1:2:1 for homozygous 
dominant, heterozygous, and homozygous recessive. 
Ha: The trait is not distributed according to the ratio 1:2:1. 


. Test statistic. The test statistic is 


"ape 


. Distribution of test statistic. If Но is true, X? is distributed as chi-square 


with 2 degrees of freedom. 


. Decision rule. Suppose we let the probability of committing a type I 


error be .05. Reject Но if the computed value of X? is equal to or greater 
than 5.991. 


. Calculation of test statistic. If Но is true, the expected frequencies for 


the three manifestations of the trait are 50, 100, and 50 for dominant, 
heterozygous, and recessive, respectively. Consequently, 


X? = (43 — 50)? /50 + (125 — 100)2/100 + (32 — 50)?/50 = 13.71 


. Statistical decision. Since 13.71 > 5.991, we reject Ho. 
. Conclusion. We conclude that the trait is not distributed according to the 


ratio 1:2:1. 
p value. Since 13.71 > 10.597, the p value for the test is р < .005. gy 
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EXERCISES 


12.3.1 


12.3.2 


12.3.3 


The following table shows the distribution of uric acid determinations taken on 250 patients. Test the 
goodness-of-fit of these data to a normal distribution with и = 5.74 and с = 2.01. Let а = .01. 


Uric Acid Observed Uric Acid Observed 
Determination Frequency Determination Frequency 
<1 1 6 to 6.99 45 
110 1.99 5 7 to 7.99 30 

2 to 2.99 15 8 to 8.99 22 

3 to 3.99 24 9 to 9.99 10 

4 to 4.99 43 10 or higher 5 

5 to 5.99 50 

Total 250 


The following data were collected on 300 eight-year-old girls. Test, at the .05 level of significance, 
the null hypothesis that the data are drawn from a normally distributed population. The sample 
mean and standard deviation computed from grouped data are 127.02 and 5.08. 


Height in Observed Height in Observed 
Centimeters Frequency Centimeters Frequency 
114 to 115.9 5 128 to 129.9 43 
116 to 117.9 10 130 to 131.9 42 
118 to 119.9 14 132 to 133.9 30 
120 to 121.9 21 134 to 135.9 11 
122 to 123.9 30 136 to 137.9 5 
124 to 125.9 40 138 to 139.9 4 
126 to 127.9 45 

Total 300 


The face sheet of patients’ records maintained in a local health department contains 10 entries. 
A sample of 100 records revealed the following distribution of erroneous entries: 


Number of Erroneous 
Entries Out of 10 Number of Records 


8 
25 


0 
1 
2 
3 24 
4 
3 


or more 1 


Total 100 
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12.3.4 


12.3.5 


Test the goodness-of-fit of these data to the binomial distribution with p — .20. Find the p value for 
this test. 


In a study conducted by Byers et al. (A-2), researchers tested a Poisson model for the distribution 
of activities of daily living (ADL) scores after a 7-month prehabilitation program designed to 
prevent functional decline among physically frail, community-living older persons. ADL meas- 
ured the ability of individuals to perform essential tasks, including walking inside the house, 
bathing, upper and lower body dressing, transferring from a chair, toileting, feeding, and 
grooming. The scoring method used in this study assigned a value of 0 for no (personal) help 
and no difficulty, 1 for difficulty but no help, and 2 for help regardless of difficulty. Scores were 
summed to produce an overall score ranging from 0 to 16 (for eight tasks). There were 181 subjects 
who completed the study. Suppose we use the authors' scoring method to assess the status of 
another group of 181 subjects relative to their activities of daily living. Let us assume that the 
following results were obtained. 


Observed Expected Observed Expected 
X Frequency Х Frequency X Frequency X Frequency 
0 74 11.01 7 4 2.95 
1 21 30.82 8 3 1.03 
2 14 43.15 9 2 0.32 
3 14 40.27 10 3 0.09 
4 11 28.19 11 4 0.02 
5 15.79 12 or more 13 0.01 
6 5 7.37 


Source: Hypothetical data based on procedure reported by Amy L. Byers, Heather Allore, 
Thomas M. Gill, and Peter N. Peduzzi, “Application of Negative Binomial Modeling for 
Discrete Outcomes: A Case Study in Aging Research,” Journal of Clinical Epidemiology, 56 
(2003), 559-564. 


Test the null hypothesis that these data were drawn from a Poisson distribution with A = 2.8. Let 
а = .01. 


The following are the numbers of а particular organism found in 100 samples of water from 
a pond: 


Number of Organisms Number of Organisms 

per Sample Frequency per Sample Frequency 
0 15 4 5 

1 30 5 4 

2 25 6 1 

3 20 7 0 
Total 100 


Test the null hypothesis that these data were drawn from a Poisson distribution. Determine the p value 
for this test. 
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12.3.6 A research team conducted a survey in which the subjects were adult smokers. Each subject in a 
sample of 200 was asked to indicate the extent to which he or she agreed with the statement: ^I would 
like to quit smoking." The results were as follows: 


Response: Strongly agree Agree Disagree Strongly Disagree 
Number 
Responding: 102 30 60 8 


Can one conclude on the basis of these data that, in the sampled population, opinions are not equally 
distributed over the four levels of agreement? Let the probability of committing a type I error be .05 
and find the p value. 


12.4 TESTS OF INDEPENDENCE 


Another, and perhaps the most frequent, use of the chi-square distribution is to test the null 
hypothesis that two criteria of classification, when applied to the same set of entities, are 
independent. We say that two criteria of classification are independent if the distribution of 
one criterion is the same no matter what the distribution of the other criterion. For example, 
if socioeconomic status and area of residence of the inhabitants of a certain city are 
independent, we would expect to find the same proportion of families in the low, medium, 
and high socioeconomic groups in all areas of the city. 


The Contingency Table Тһе classification, according to two criteria, of a set of 
entities, say, people, can be shown by a table in which the r rows represent the various 
levels of one criterion of classification and the c columns represent the various levels of the 
second criterion. Such a table is generally called a contingency table, with dimension r x c. 
The classification according to two criteria of a finite population of entities is shown in 
Table 12.4.1. 

We will be interested in testing the null hypothesis that in the population the two 
criteria of classification are independent. If the hypothesis is rejected, we will conclude that 


TABLE 12.4.1 Two-Way Classification of a Finite 
Population of Entities 


Second 

Criterion of First Criterion of Classification Level 

Classification 

Level 1 2 3 sits с Total 
Ми No Nx Nic № 

2 Na Na М» Nac № 

3 Na № Nas Nac Na 

r Na №2 Мз М N, 


Total Ni №2 Мз cec. N.c N 
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TABLE 12.4.2 Two-Way Classification of a Sample 
of Entities 


Second 

Criterion of First Criterion of Classification Level 
Classification 

Level 1 2 3 20 с Тота! 
1 N11 m2 піз ЖО Пс m. 
2 N21 N22 N23 ... П2с n2. 
3 N31 N32 N33 ... Пзс ns. 
r nn nr пз Ao. Nre nr. 
Total na n.2 n.3 SPT П.с п 


the two criteria of classification are not independent. А sample of size n will be drawn from 
the population of entities, and the frequency of occurrence of entities in the sample 
corresponding to the cells formed by the intersections of the rows and columns of Table 
12.4.1 along with the marginal totals will be displayed in a table such as Table 12.4.2. 


Calculating the Expected Frequencies The expected frequency, under 
the null hypothesis that the two criteria of classification are independent, is calculated for 
each cell. 

We learned in Chapter 3 (see Equation 3.4.4) that if two events are independent, the 
probability of their joint occurrence is equal to the product of their individual probabilities. 
Under the assumption of independence, for example, we compute the probability that one 
of the n subjects represented in Table 12.4.2 will be counted in Row 1 and Column 1 of the 
table (that is, in Cell 11) by multiplying the probability that the subject will be counted in 
Row 1 by the probability that the subject will be counted in Column 1. In the notation of the 
table, the desired calculation is 

ni (MA 
Go Ge 


To obtain the expected frequency for Cell 11, we multiply this probability by the total 
number of subjects, n. That is, the expected frequency for Cell 11 is given by 


MN (NA 
Co 
n n 
Since the n in one of the denominators cancels into numerator n, this expression reduces to 
(пт.) (п.1) 
n 


In general, then, we see that to obtain the expected frequency for a given cell, we multiply 
the total of the row in which the cell is located by the total of the column in which the cell is 
located and divide the product by the grand total. 
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Observed Versus Expected Frequencies The expected frequencies and 
Observed frequencies are compared. If the discrepancy is sufficiently small, the null 
hypothesis is tenable. If the discrepancy is sufficiently large, the null hypothesis is rejected, 
and we conclude that the two criteria of classification are not independent. The decision as 
to whether the discrepancy between observed and expected frequencies is sufficiently large 
to cause rejection of Но will be made on the basis of the size of the quantity computed when 
we use Equation 12.2.4, where O; and E; refer, respectively, to the observed and expected 
frequencies in the cells of Table 12.4.2. It would be more logical to designate the observed 
and expected frequencies in these cells by O;; and Ех, but to keep the notation simple and to 
avoid the introduction of another formula, we have elected to use the simpler notation. It 
will be helpful to think of the cells as being numbered from 1 to k, where 1 refers to Cell 11 
and k refers to Cell rc. It can be shown that X? as defined in this manner is distributed 
approximately as x? with (r — 1)(c — 1) degrees of freedom when the null hypothesis is 
true. If the computed value of X is equal to or larger than the tabulated value of x° for some 
a, the null hypothesis is rejected at the o level of significance. The hypothesis testing 
procedure is illustrated with the following example. 


EXAMPLE 12.4.1 


In 1992, the U.S. Public Health Service and the Centers for Disease Control and Prevention 
recommended that all women of childbearing age consume 400 pg of folic acid daily to 
reduce the risk of having a pregnancy that is affected by a neural tube defect such as spina 
bifida or anencephaly. In a study by Stepanuk et al. (A-3), 693 pregnant women called a 
teratology information service about their use of folic acid supplementation. The research- 
ers wished to determine if preconceptional use of folic acid and race are independent. The 
data appear in Table 12.4.3. 


Solution: 


1. Data. See Table 12.4.3. 


2. Assumptions. We assume that the sample available for analysis is equiv- 
alent to a simple random sample drawn from the population of interest. 


TABLE 12.4.3 Race of Pregnant Caller and Use of 


Folic Acid 
Preconceptional Use of Folic Acid 
Yes No Total 
White 260 299 559 
Black 15 41 56 
Other 7 14 21 
Total 282 354 636 


Source: Kathleen M. Stepanuk, Jorge E. Tolosa, Dawneete Lewis, Victoria 
Meyers, Cynthia Royds, Juan Carlos Saogal, and Ron Librizzi, “Folic Acid 
Supplementation Use Among Women Who Contact a Teratology Information 
Service," American Journal of Obstetrics and Gynecology, 187 (2002), 964-967. 
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Hypotheses. 


Ho: Race and preconceptional use of folic acid are independent. 
На: The two variables are not independent. 
Let a = .05. 


. Test statistic. The test statistic is 


k 
Х? = 5 
1=1 


(O; Е)? 
Ej 


. Distribution of test statistic. When Но is true, X? is distributed 


approximately as x^ with (r — 1)(c — 1) = (3— 1)(2 - 1) = (2)(1) = 
2 degrees of freedom. 


. Decision rule. Reject Но if the computed value of X? is equal to or 


greater than 5.991. 


. Calculation of test statistic. The expected frequency for the first cell is 


(559 x 282)/636 — 247.86. The other expected frequencies are calcu- 
lated in a similar manner. Observed and expected frequencies are 
displayed in Table 12.4.4. From the observed and expected frequencies 
we may compute 


0; — E 

Xx? 22 ( 1 І 
_ (260—247.86) (299 — 311.14)? (14 — 11.69)? 
Е 247.86 311.14 11.69 


.59461 + .47368 +... + .45647 = 9.08960 


. Statistical decision. We reject H since 9.08960 > 5.99]. 
. Conclusion. We conclude that Но is false, and that there is a relationship 


between race and preconceptional use of folic acid. 


10. p value. Since 7.378 < 9.08960 < 9.210, .01 < p < .025. 


TABLE 12.4.4 Observed and Expected Frequencies 
for Example 12.4.1 


Preconceptional Use of Folic Acid 


Yes No Total 
White 260 (247.86) 299 (311.14) 559 
Black 15 (24.83) 41 (31.17) 56 
Other 7 (9.31) 14 (11.69) 21 
Total 282 354 636 
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Computer Analysis Тһе computer may be used to advantage in calculating X? for 
tests of independence and tests of homogeneity. Figure 12.4.1 shows the procedure and 
printout for Example 12.4.1 when the MINITAB program for computing X? from 
contingency tables is used. The data were entered into MINITAB Columns 1 and 2, 
corresponding to the columns of Table 12.4.3. 

We may use SAS? to obtain an analysis and printout of contingency table data by 
using the PROC FREQ statement. Figure 12.4.2 shows a partial SAS? printout reflecting 
the analysis of the data of Example 12.4.1. 


Data: 


C1: 26015 7 
C2: 299 41 14 


Dialog Box: Session command: 


Stat » Tables » Chi-square Test MTB » CHISQUARE 


Type С1-С2 in Columns containing the table. 
Click OK. 


Output: 


Chi-Square Test: C1, C2 


Expected counts are printed below observed counts 


CI C2 Total 
260 299 559 
247.86 311.14 


41 


FIGURE 12.4.1 MINITAB procedure and output for chi-square analysis of data in Table 12.4.3. 
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The SAS System 
The FREQ Procedure 
Table of race by folic 


race folic 
Frequency 
Percent 
Row Pct 


100.00 
Statistics for Table of race by folic 


Statistic 


Chi-Square 

Likelihood Ratio Chi-Square 
Mantel—Haenszel Chi-Square 
Phi Coefficient 

Contingency Coefficient 
Cramer's V 


Sample Size = 636 


FIGURE 12.4.2 Partial SAS? printout for the chi-square analysis of the data from 
Example 12.4.1. 
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Note that the SAS® printout shows, in each cell, the percentage that cell frequency is 
of its row total, its column total, and the grand total. Also shown, for each row and column 
total, is the percentage that the total is of the grand total. In addition to the X? statistic, 
SAS? gives the value of several other statistics that may be computed from contingency 
table data. One of these, the Mantel-Haenszel chi-square statistic, will be discussed in a 
later section of this chapter. 


Small Expected Frequencies The problem of small expected frequencies 
discussed in the previous section may be encountered when analyzing the data of 
contingency tables. Although there is a lack of consensus on how to handle this problem, 
many authors currently follow the rule given by Cochran (5). He suggests that for 
contingency tables with more than 1 degree of freedom a minimum expectation of 1 is 
allowable if no more than 20 percent of the cells have expected frequencies of less than 5. 
To meet this rule, adjacent rows and/or adjacent columns may be combined when to 
do so is logical in light of other considerations. If X? is based on less than 30 degrees of 
freedom, expected frequencies as small as 2 can be tolerated. We did not experience the 
problem of small expected frequencies in Example 12.4.1, since they were all greater 
than 5. 


The 2 x 2 Contingency Table Sometimes each of two criteria of classifica- 
tion may be broken down into only two categories, or levels. When data are cross- 
classified in this manner, the result is a contingency table consisting of two rows and two 
columns. Such a table is commonly referred to as a 2 x 2 table. The value of X? may be 
computed by first calculating the expected cell frequencies in the manner discussed 
above. In the case of a 2 x 2 contingency table, however, x may be calculated by the 
following shortcut formula: 


oe n(ad — bc)? (124.1) 
(a+ c)(b 4- d)(a 4- b)(c + d) Еа 


where а, b, c, and d are the observed cell frequencies as shown in Table 12.4.5. When we 
apply the (r — 1)(c — 1) rule for finding degrees of freedom to a 2 x 2 table, the result is 
] degree of freedom. Let us illustrate this with an example. 


TABLE 12.4.5 A 2x2 Contingency Table 


First Criterion of Classification 
Second Criterion 


of Classification 1 2 Total 
1 a b a+b 
2 с а с+а 


Total a+c b+d n 
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EXAMPLE 12.4.2 


According to Silver and Aiello (A-4), falls are of major concern among polio survivors. 
Researchers wanted to determine the impact of a fall on lifestyle changes. Table 12.4.6 
shows the results of a study of 233 polio survivors on whether fear of falling resulted in 
lifestyle changes. 


Solution: 


. Data. From the information given we may construct the 2 x 2 contin- 


gency table displayed as Table 12.5.6. 


. Assumptions. We assume that the sample is equivalent to a simple 


random sample. 


. Hypotheses. 


Ho: Fall status and lifestyle change because of fear of falling are 
independent. 
Ну: The two variables are not independent. 


Let a = .05. 


. Test statistic. The test statistic is 


k 
X= 5 
1=1 


(O; Е)? 
Ej 


. Distribution of test statistic. When Но is true, Х is distributed 


approximately as x? with (r — 1)(c - 1) = (2- 1)(2— 1) = (1)(1) = 
] degree of freedom. 


. Decision rule. Reject Но if the computed value of X? is equal to or 


greater than 3.841. 


. Calculation of test statistic. By Equation 12.4.1 we compute 


уг __ 23310131)(36) - (52)(14)]? 
— — (145)(88)(183)(50) 


— 31.7391 


8. Statistical decision. We reject Но since 31.7391 > 3.841. 


TABLE 12.4.6 Contingency Table for the Data of Example 12.4.2 


Made Lifestyle Changes Because of Fear of Falling 


Yes No Total 
Fallers 131 52 183 
Nonfallers 14 36 50 
Total 145 88 233 


Source: J. K. Silver and D. D. Aiello, "Polio Survivors: Falls and Subsequent Injuries," 
American Journal of Physical Medicine and Rehabilitation, 81 (2002), 567—570. 


12.4 TESTS OFINDEPENDENCE 627 


9. Conclusion. We conclude that Но is false, and that there is a relationship 
between experiencing a fall and changing one's lifestyle because of fear 
of falling. 


10. p value. Since 31.7391 > 7.879, р < .005. и 


Small Expected Frequencies The problems of how to handle small expected 
frequencies and small total sample sizes may arise in the analysis of 2 x 2 contingency 
tables. Cochran (5) suggests that the x° test should not be used if п < 20 or if 20 < n < 40 
and any expected frequency is less than 5. When n — 40, an expected cell frequency as 
small as 1 can be tolerated. 


Yates's Correction The observed frequencies in a contingency table are discrete 
and thereby give rise to a discrete statistic, Х?, which is approximated by the x 
distribution, which is continuous. Yates (6) in 1934 proposed a procedure for correcting 
for this in the case of 2 x 2 tables. The correction, as shown in Equation 12.4.2, consists of 
subtracting half the total number of observations from the absolute value of the quantity 
ad — bc before squaring. That is, 


2 паа — be| — Sn)? 
X = 
corrected (a+ c)(b + d)(a 4- b)(c + d) 


(12.4.2) 


It is generally agreed that no correction is necessary for larger contingency tables. 
Although Yates's correction for 2 x 2 tables has been used extensively in the past, 
more recent investigators have questioned its use. As a result, some practitioners recom- 
mend against its use. 

We may, as a matter of interest, apply the correction to our current example. Using 
Equation 12.4.2 and the data from Table 12.4.6, we may compute 


y= 233[1(131)(36) — (52)(14)| — .5(233)]? 


(145) (88)(183) (50) Бс 


As might be expected, with a sample this large, the difference in the two results is not 
dramatic. 


Tests of Independence: Characteristics The characteristics of a chi- 
square test of independence that distinguish it from other chi-square tests are as follows: 


1. A single sample is selected from a population of interest, and the subjects or objects 
are cross-classified on the basis of the two variables of interest. 


2. The rationale for calculating expected cell frequencies is based on the probability 
law, which states that if two events (here the two criteria of classification) are 
independent, the probability of their joint occurrence is equal to the product of their 
individual probabilities. 


3. The hypotheses and conclusions are stated in terms of the independence (or lack of 
independence) of two variables. 
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EXERCISES 


12.4.1 


12.4.2 


12.4.3 


In the exercises that follow perform the test at the indicated level of significance and determine the p 
value. 


In the study by Silver and Aiello (A-4) cited in Example 12.4.2, a secondary objective was to 
determine if the frequency of falls was independent of wheelchair use. The following table gives the 
data for falls and wheelchair use among the subjects of the study. 


Wheelchair Use 
Yes No 
Fallers 62 121 
Nonfallers 18 32 


Source: J. K. Silver and D. D. Aiello, “Polio Survivors: Falls and 
Subsequent Injuries," American Journal of Physical Medicine and 
Rehabilitation, 81 (2002), 567—570. 


Do these data provide sufficient evidence to warrant the conclusion that wheelchair use and falling are 
related? Let a = .05. 


Sternal surgical site infection (SSI) after coronary artery bypass graft surgery is a complication that 
increases patient morbidity and costs for patients, payers, and the health care system. Segal and 
Anderson (A-5) performed a study that examined two types of preoperative skin preparation before 
performing open heart surgery. These two preparations used aqueous iodine and insoluble iodine with 
the following results. 


Comparison of Aqueous 
and Insoluble Preps 


Prep Group Infected Not Infected 
Aqueous iodine 14 94 
Insoluble iodine 4 97 


Source: Cynthia G. Segal and Jacqueline J. Anderson, “Preoperative Skin 
Preparation of Cardiac Patients," AORN Journal, 76 (2002), 821-827. 


Do these data provide sufficient evidence at ће о = .05 level to justify the conclusion that the type of 
skin preparation and infection are related? 


The side effects of nonsteroidal antiinflammatory drugs (NSAIDs) include problems involving peptic 
ulceration, renal function, and liver disease. In 1996, the American College of Rheumatology issued 
and disseminated guidelines recommending baseline tests (CBC, hepatic panel, and renal tests) when 
prescribing NSAIDs. A study was conducted by Rothenberg and Holcomb (A-6) to determine if 
physicians taking part in a national database of computerized medical records performed the 
recommended baseline tests when prescribing NSAIDs. The researchers classified physicians in 
the study into four categories—those practicing in internal medicine, family practice, academic 
family practice, and multispeciality groups. The data appear in the following table. 


12.4.4 


12.4.5 


12.4.6 
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Performed Baseline Tests 


Practice Type Yes No 

Internal medicine 294 921 
Family practice 98 2862 
Academic family practice 50 3064 
Multispecialty groups 203 2652 


Source: Ralph Tothenberg and John P. Holcomb, “Guidelines for Monitoring of NSAIDs: Who 
Listened?,” Journal of Clinical Rheumatology, 6 (2000), 258-265. 


Do the data above provide sufficient evidence for us to conclude that type of practice and 
performance of baseline tests are related? Use o — .01. 


Boles and Johnson (A-7) examined the beliefs held by adolescents regarding smoking and weight. 
Respondents characterized their weight into three categories: underweight, overweight, or appropri- 
ate. Smoking status was categorized according to the answer to the question, “Do you currently 
smoke, meaning one or more cigarettes per day?" The following table shows the results of a telephone 
study of adolescents in the age group 12-17. 


Smoking 
Yes No 
Underweight 17 97 
Overweight 25 142 
Appropriate 96 816 


Source: Sharon M. Boles and Patrick B. Johnson, “Gender, Weight Concerns, and Adolescent 
Smoking," Journal of Addictive Diseases, 20 (2001), 5-14. 


Do the data provide sufficient evidence to suggest that weight perception and smoking status are 
related in adolescents? o — .05. 


A sample of 500 college students participated in a study designed to evaluate the level of college 
students' knowledge of a certain group of common diseases. The following table shows the students 
classified by major field of study and level of knowledge of the group of diseases: 


Knowledge of Diseases 


Major Good Poor Total 
Premedical 31 91 122 
Other 19 359 378 
Total 50 450 500 


Do these data suggest that there is a relationship between knowledge of the group of diseases 
and major field of study of the college students from which the present sample was drawn? 
Let a = .05. 


The following table shows the results of a survey in which the subjects were a sample of 300 adults 
residing in a certain metropolitan area. Each subject was asked to indicate which of three policies they 
favored with respect to smoking in public places. 
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Policy Favored 
No Smoking Allowed No 

Highest Education Restrictions in Designated Smoking No 

Level on Smoking Areas Only at All Opinion Total 
College graduate 5 44 23 3 75 
High-school graduate 15 100 30 5 150 
Grade-school graduate 15 40 10 10 75 
Total 35 184 63 18 300 


Can one conclude from these data that, in the sampled population, there is a relationship between 
level of education and attitude toward smoking in public places? Let œ = .05. 


12.5 TESTS OF HOMOGENEITY 


A characteristic of the examples and exercises presented in the last section is that, in each 
case, the total sample was assumed to have been drawn before the entities were classified 
according to the two criteria of classification. That is, the observed number of entities falling 
into each cell was determined after the sample was drawn. As a result, the row and column 
totals are chance quantities not under the control of the investigator. We think of the sample 
drawn under these conditions as a single sample drawn from a single population. On 
occasion, however, either row or column totals may be under the control of the investigator; 
that is, the investigator may specify that independent samples be drawn from each of several 
populations. In this case, one set of marginal totals is said to be fixed, while the other set, 
corresponding to the criterion of classification applied to the samples, is random. The former 
procedure, as we have seen, leads to a chi-square test of independence. The latter situation 
leads to a chi-square test of homogeneity. The two situations not only involve different 
sampling procedures; they lead to different questions and null hypotheses. The test of 
independence is concerned with the question: Are the two criteria of classification indepen- 
dent? The homogeneity test is concerned with the question: Are the samples drawn from 
populations that are homogeneous with respect to some criterion of classification? In the 
latter case the null hypothesis states that the samples are drawn from the same population. 
Despite these differences in concept and sampling procedure, the two tests are mathemati- 
cally identical, as we see when we consider the following example. 


Calculating Expected Frequencies Either the row categories or the col- 
umn categories may represent the different populations from which the samples are drawn. 
If, for example, three populations are sampled, they may be designated as populations 1, 2, 
and 3, in which case these labels may serve as either row or column headings. If the variable 
of interest has three categories, say, A, B, and C, these labels may serve as headings for rows 
or columns, whichever is not used for the populations. If we use notation similar to that 
adopted for Table 12.4.2, the contingency table for this situation, with columns used to 
represent the populations, is shown as Table 12.5.1. Before computing our test statistic we 
need expected frequencies for each of the cells in Table 12.5.1. If the populations are indeed 
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TABLE 12.5.1 A Contingency Table for Data for a 
Chi-Square Test of Homogeneity 


Population 
Variable Category 1 2 3 Total 
A nai ПА2 ПАз ПА. 
В NB1 Ng2 Пвз ng. 
C nci пе? nca nc. 
Total па n.2 n.3 n 


homogeneous, or, equivalently, if the samples are all drawn from the same population, with 
respect to the categories A, B, and C, our best estimate of the proportion in the combined 
population who belong to category А is пд /п. By the same token, if the three populations 
are homogeneous, we interpret this probability as applying to each of the populations 
individually. For example, under the null hypothesis, n4. is our best estimate of the 
probability that a subject picked at random from the combined population will belong to 
category A. We would expect, then, to find nı (пд. /n) of those in the sample from population 
1 to belong to category А, n.» (пл. /n) of those in the sample from population 2 to belong to 
category A, and п,з(пд /п) of those in the sample from population 3 to belong to category A. 
These calculations yield the expected frequencies for the first row of Table 12.5.1. Similar 
reasoning and calculations yield the expected frequencies for the other two rows. 

We see again that the shortcut procedure of multiplying appropriate marginal totals 
and dividing by the grand total yields the expected frequencies for the cells. 

From the data in Table 12.5.1 we compute the following test statistic: 


за У (0; - Е)? 


EXAMPLE 12.5.1 


Narcolepsy is a disease involving disturbances of the sleep-wake cycle. Members of the 
German Migraine and Headache Society (A-8) studied the relationship between migraine 
headaches in 96 subjects diagnosed with narcolepsy and 96 healthy controls. The results 
are shown in Table 12.5.2. We wish to know if we may conclude, on the basis of these data, 


TABLE 12.5.2 Frequency of Migraine Headaches by Narcolepsy Status 


Reported Migraine Headaches 


Yes No Total 
Narcoleptic subjects 21 75 96 
Healthy controls 19 77 96 
Total 40 152 192 


Source: The DMG Study Group, "Migraine and Idiopathic Narcolepsy—A Case-Control Study," 
Cephalagia, 23 (2003), 786-789. 
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that the narcolepsy population and healthy populations represented by the samples are not 
homogeneous with respect to migraine frequency. 


Solution: 


1. Data. See Table 12.5.2. 

2. Assumptions. We assume that we have a simple random sample from 
each of the two populations of interest. 

3. Hypotheses. 


Ho: The two populations are homogeneous with respect to migraine 
frequency. 

На: The two populations are not homogeneous with respect to migraine 
frequency. 

Let a = .05. 


4. Test statistic. The test statistic is 


х-у` © SEY JE; 
5. Distribution of test statistic. If Но is true, X? is distributed approxi- 
mately as x? with (2 — 1)(2 — 1) = (1)(1) = 1 degree of freedom. 
6. Decision rule. Reject Но if the computed value of X? is equal to or 
greater than 3.841. 


7. Calculation of test statistic. The MINITAB output is shown in Figure 
12.5.1. 


Chi-Square Test 


Expected counts are printed below observed counts 
Rows: Narcolepsy Columns: Migraine 
No Yes All 


77 
76.00 


75 
76.00 


152 
152.00 


Chi-Square = 0.126, 


FIGURE 12.5.1 MINITAB output for Example 12.5.1. 
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8. Statistical decision. Since .126 is less than the critical value of 3.841, 
we are unable to reject the null hypothesis. 


9. Conclusion. We conclude that the two populations may be homoge- 
neous with respect to migraine frequency. 


10. p value. From the MINITAB output we see that p — .722. ш 


Small Expected Frequencies The rules for small expected frequencies given 
in the previous section are applicable when carrying out a test of homogeneity. 
In summary, the chi-square test of homogeneity has the following characteristics: 


1. Two or more populations are identified in advance, and an independent sample is 
drawn from each. 


2. Sample subjects or objects are placed in appropriate categories of the variable of 
interest. 


3. The calculation of expected cell frequencies is based on the rationale that if the 
populations are homogeneous as stated in the null hypothesis, the best estimate of the 
probability that a subject or object will fall into a particular category of the variable of 
interest can be obtained by pooling the sample data. 


4. The hypotheses and conclusions are stated in terms of homogeneity (with respect to 
the variable of interest) of populations. 


Test of Homogeneity and Ho:p, = P2 The chi-square test of homogeneity 
for the two-sample case provides an alternative method for testing the null hypothesis that 
two population proportions are equal. In Section 7.6, it will be recalled, we learned to test 
Но:р = р» against НА :р # p, by means of the statistic 


го Фі) фі Poo 
A A 


nı n2 


where p is obtained by pooling the data of the two independent samples available for 
analysis. 

Suppose, for example, that in a test of Ho:p, = p; against Ha:p, 7 ро, the sample 
data were as follows: пі = 100, p, = .60, т = 120, р» = .40. When we pool the sample 
data we have 


-. .60(100)--.40(120) _ 108 _ 
P-—00-po  xmo 799 
and 
= ae = 2.95469 
ЕЕ И (.4909)(.5091) 
100 120 


which is significant at the .05 level since it is greater than the critical value of 1.96. 
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If we wish to test the same hypothesis using the chi-square approach, our contin- 
gency table will be 


Characteristic Present 


Sample Yes No Total 
1 60 40 100 
2 48 72 120 
Total 108 112 220 


By Equation 12.4.1 we compute 


, | 220[(60)(72) — (40) (48)? 


(108)(112)(100)(120) — 8.7302 


which is significant at the .05 level because it is greater than the critical value of 3.841. We 
see, therefore, that we reach the same conclusion by both methods. This is not surprising 
because, as explained in Section 12.2, Xi) = 2°. We note that 8.7302 = (2.95469)? and 
that 3.841 — (1.96)?. 


EXERCISES 


12.5.1 


In the exercises that follow perform the test at the indicated level of significance and determine the p 
value. 


Refer to the study by Carter et al. [A-9], who investigated the effect of age at onset of bipolar disorder 
on the course of the illness. One of the variables studied was subjects' family history. Table 3.4.1 
shows the frequency of a family history of mood disorders in the two groups of interest: early age at 
onset (18 years or younger) and later age at onset (later than 18 years). 


Family History of Mood 

Disorders Early < 18(Е) Later > 18(L) Total 
Negative (A) 28 35 63 
Bipolar disorder (B) 19 38 57 
Unipolar (C) 4] 44 85 
Unipolar and bipolar (D) 53 60 113 
Total 141 177 318 


Source: Tasha D. Carter, Emanuela Mundo, Sagar V. Parkh, and James L. Kennedy, 
“Early Age at Onset as a Risk Factor for Poor Outcome of Bipolar Disorder,” Journal of 
Psychiatric Research, 37 (2003), 297—303. 


Can we conclude on the basis of these data that subjects 18 or younger differ from subjects older than 
18 with respect to family histories of mood disorders? Let œ = .05. 


12.5.2 


12.5.3 


12.5.4 
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Coughlin et al. (A-10) examined breast and cervical screening practices of Hispanic and non- 
Hispanic women in counties that approximate the U.S. southern border region. The study used data 
from the Behavioral Risk Factor Surveillance System surveys of adults ages 18 years or older 
conducted in 1999 and 2000. The following table shows the number of observations of Hispanic 
and non-Hispanic women who had received a mammogram in the past 2 years cross-classified by 
marital status. 


Marital Status Hispanic Non-Hispanic Total 
Currently married 319 738 1057 
Divorced or separated 130 329 459 
Widowed 88 402 490 
Never married or living as 41 95 136 


an unmarried couple 


Total 578 1564 2142 


Source: Steven S. Coughlin, Robert J. Uhler, Thomas Richards, and Katherine 
M. Wilson, “Breast and Cervical Cancer Screening Practices Among Hispanic 
and Non-Hispanic Women Residing Near the United States-Mexico Border, 
1999-2000,” Family and Community Health, 26, (2003), 130-139. 


We wish to know if we may conclude on the basis of these data that marital status and ethnicity 
(Hispanic and non-Hispanic) in border counties of the southern United States are not homogeneous. 
Let a = .05. 


Swor et al. (A-11) examined the effectiveness of cardiopulmonary resuscitation (CPR) training in 
people over 55 years of age. They compared the skill retention rates of subjects in this age group who 
completed a course in traditional CPR instruction with those who received chest-compression-only 
cardiopulmonary resuscitation (CC-CPR). Independent groups were tested 3 months after training. 
Among the 27 subjects receiving traditional CPR, 12 were rated as competent. In the CC-CPR group, 
15 out of 29 were rated competent. Do these data provide sufficient evidence for us to conclude that 
the two populations are not homogeneous with respect to competency rating 3 months after training? 
Let о = .05. 


In an air pollution study, a random sample of 200 households was selected from each of two 
communities. A respondent in each household was asked whether or not anyone in the household was 
bothered by air pollution. The responses were as follows: 


Any Member of Household 

Bothered by Air Pollution? 
Community Yes No Total 
I 43 157 200 
II 81 119 200 
Total 124 276 400 


Can the researchers conclude that the two communities differ with respect to the variable of interest? 
Let a = .05. 
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12.5.5 


In a simple random sample of 250 industrial workers with cancer, researchers found that 102 had 
worked at jobs classified as “high exposure" with respect to suspected cancer-causing agents. Of the 
remainder, 84 had worked at moderate exposure" jobs, and 64 had experienced no known exposure 
because of their jobs. In an independent simple random sample of 250 industrial workers from 
the same area who had no history of cancer, 31 worked in "high exposure" jobs, 60 worked in 
“moderate exposure" jobs, and 159 worked in jobs involving no known exposure to suspected cancer- 
causing agents. Does it appear from these data that persons working in jobs that expose them to 
suspected cancer-causing agents have an increased risk of contracting cancer? Let o — .05. 


12.6 THEFISHER EXACT TEST 


Sometimes we have data that can be summarized in a 2 x 2 contingency table, but these 
data are derived from very small samples. The chi-square test is not an appropriate method 
of analysis if minimum expected frequency requirements are not met. If, for example, n is 
less than 20 or if n is between 20 and 40 and one of the expected frequencies is less than 5, 
the chi-square test should be avoided. 

A test that may be used when the size requirements of the chi-square test are not met 
was proposed in the mid-1930s almost simultaneously by Fisher (7,8), Irwin (9), and Yates 
(10). The test has come to be known as the Fisher exact test. It 1s called exact because, if 
desired, it permits us to calculate the exact probability of obtaining the observed results or 
results that are more extreme. 


Data Arrangement When we use the Fisher exact test, we arrange the data in the 
form of a 2 x 2 contingency table like Table 12.6.1. We arrange the frequencies in such a 
way that A > B and choose the characteristic of interest so that a/A > b/B. 

Some theorists believe that Fisher's exact test is appropriate only when both marginal 
totals of Table 12.6.1 are fixed by the experiment. This specific model does not appear to 
arise very frequently in practice. Many experimenters, therefore, use the test when both 
marginal totals are not fixed. 


Assumptions The following are the assumptions for the Fisher exact test. 


1. The data consist of A sample observations from population 1 and B sample 
observations from population 2. 
2. The samples are random and independent. 


3. Each observation can be categorized as one of two mutually exclusive types. 


TABLE 12.6.1 A 2x2 Contingency Table for the Fisher Exact Test 


With Without 
Sample Characteristic Characteristic Total 
a А-а А 
2 [2] B-b B 


Total a+b A+B-a-b A+B 
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Hypotheses The following are the null hypotheses that may be tested and their 
alternatives. 


1. (Two-sided) 
Ho: The proportion with the characteristic of interest is the same in both populations; 
that is, p, = р». 
На: The proportion with the characteristic of interest is not the same in both 
populations; p, Z р». 
2. (One-sided) 
Но: The proportion with the characteristic of interest in population 1 is less than or 
the same as the proportion in population 2; p, < р». 
Ha: The proportion with the characteristic of interest is greater in population 1 than 
in population 2; p, > р». 


Test Statistic The test statistic is b, the number in sample 2 with the characteristic 
of interest. 


Decision Rule  Finney (11) has prepared critical values of b for A < 15. Latscha 
(12) has extended Finney's tables to accommodate values of A up to 20. Appendix Table J 
gives these critical values of b for A between 3 and 20, inclusive. Significance levels of .05, 
.025, .01, and .005 are included. The specific decision rules are as follows: 


1. Two-sided test. Enter Table J with A, B, and a. If the observed value of b is equal to 
or less than the integer in a given column, reject Но at a level of significance equal to 
twice the significance level shown at the top of that column. For example, suppose 
А = 8, В = 7, а = 7, and the observed value of b is 1. We can reject the null 
hypothesis at the 2(.05) — .10, the 2(.025) — .05, and the 2(.01) — .02 levels of 
significance, but not at the 2(.005) — .01 level. 


2. One-sided test. Enter Table J with A, B, and a. If the observed value of b is less than 
or equal to the integer in a given column, reject Но at the level of significance shown 
at the top of that column. For example, suppose that A — 16, B — 8, a — 4, and the 
observed value of b is 3. We can reject the null hypothesis at the .05 and .025 levels of 
significance, but not at the .01 or .005 levels. 


Large-Sample Approximation For sufficiently large samples we can test the 
null hypothesis of the equality of two population proportions by using the normal 
approximation. Compute 


¿E Me B) (12.6.1) 


УРА — p)(1/A + МВ) 


where 
р = (a+ b)/(A + B) (12.6.2) 


and compare it for significance with appropriate critical values of the standard normal 
distribution. The use of the normal approximation is generally considered satisfactory if a, 
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b, A — a, and B — b are all greater than or equal to 5. Alternatively, when sample sizes are 
sufficiently large, we may test the null hypothesis by means of the chi-square test. 


Further Reading The Fisher exact test has been the subject of some controversy 
among statisticians. Some feel that the assumption of fixed marginal totals is unrealistic in 
most practical applications. The controversy then centers around whether the test is 
appropriate when both marginal totals are not fixed. For further discussion of this and other 
points, see the articles by Barnard (13-15), Fisher (16), and Pearson (17). 

Sweetland (18) compared the results of using the chi-square test with those obtained 
using the Fisher exact test for samples of size A + B = 3 to A+ B = 69. He found close 
agreement when A and B were close in size and the test was one-sided. 

Carr (19) presents an extension of the Fisher exact test to more than two samples of 
equal size and gives an example to demonstrate the calculations. Neave (20) presents the 
Fisher exact test in a new format; the test is treated as one of independence rather than of 
homogeneity. He has prepared extensive tables for use with his approach. 

The sensitivity of Fisher's exact test to minor perturbations in 2 x 2 contingency 
tables is discussed by Dupont (21). 


EXAMPLE 12.6.1 


The purpose of a study by Justesen et al. (A-12) was to evaluate the long-term efficacy of 
taking indinavir/ritonavir twice a day in combination with two nucleoside reverse 
transcriptase inhibitors among HIV-positive subjects who were divided into two groups. 
Group 1 consisted of patients who had no history of taking protease inhibitors (PI Naive). 
Group 2 consisted of patients who had a previous history taking a protease inhibitor (PI 
Experienced). Table 12.6.2 shows whether these subjects remained on the regimen for the 
120 weeks of follow-up. We wish to know if we may conclude that patients classified as 
group 1 have a lower probability than subjects in group 2 of remaining on the regimen for 
120 weeks. 


TABLE 12.6.2 Regimen Status at 120 Weeks for 
PI Naive and PI Experienced Subjects Taking 
Indinavir/Ritonavir as Described in Example 12.6.1 


Remained in 
the Regimen 


for 120 Weeks 
Total Yes No 
1 (PI Naive) 9 2 7 
2 (PA Experienced) 12 8 
Total 21 10 11 


Source: U.S. Justesen, A. M. Lervfing, A. Thomsen, J. A. Lindberg, 
C. Pedersen, and P. Tauris, "Low-Dose Indinavir in Combination with 
Low-Dose Ritonavir: Steady-State Pharmacokinetics and Long-Term 
Clinical Outcome Follow-Up," HIV Medicine, 4 (2003), 250-254. 
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TABLE 12.6.3 Data of Table 12.6.2 Rearranged to Conform to the 
Layout of Table 12.6.1 


Remained in Regimen for 120 Weeks 


Yes No Total 
2 (PI Experienced) 8=a 4=A-a 12=A 
1 (PI Naive) 2=b 7=B-b 9=B 
Total 10=a+b 11=A+B-a-b 21=A+B 
Solution: 


10. 


Data. The data as reported are shown in Table 12.6.2. Table 12.6.3 
shows the data rearranged to conform to the layout of Table 12.6.1. 
Remaining on the regimen is the characteristic of interest. 


Assumptions. We presume that the assumptions for application of the 

Fisher exact test are met. 

Hypotheses. 

Ho: The proportion of subjects remaining 120 weeks on the regimen in a 
population of patients classified as group 2 is the same as or less 
than the proportion of subjects remaining on the regimen 120 weeks 
in a population classified as group 1. 

Ha: Group 2 patients have a higher rate than group 1 patients of 
remaining on the regimen for 120 weeks. 


Test statistic. The test statistic is the observed value of b as shown in 
Table 12.6.3. 


Distribution of test statistic. We determine the significance of b by 
consulting Appendix Table J. 


Decision rule. Suppose we let o = .05. The decision rule, then, is to 
reject Ho if the observed value of b is equal to or less than 1, the value of 
b in Table J for = 12, B = 9, а = 8, апа a = .05. 

Calculation of test statistic. The observed value of b, as shown in 
Table 12.6.3, is 2. 


Statistical decision. Since 2 > 1, we fail to reject Ho. 


Conclusion. Since we fail to reject Ho, we conclude that the null 
hypothesis may be true. That is, it may be true that the rate of remaining 
on the regimen for 120 weeks is the same or less for the PI experienced 
group compared to the PI naive group. 

p value. We see in Table J that when A = 12, B = 9, a = 8, the value of 
b = 2 has an exact probability of occurring by chance alone, when Но is 
true, greater than .05. и 
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PI * Remained Cross-Tabulation 


Count 
Remained 
Yes No Total 
Pl Experienced 8 4 12 
Naive 2 7 9 
Total 10 1 21 


Chi-Square Tests 


Asymp. Sig. Exact Sig. Exact Sig. 
Value df (2-sided) (2-sided) (1-sided) 
Pearson Chi-Square 4.073P| 1 .044 
Continuity Correction? | 2.486 1 ‚115 
Likelihood Ratio 4.253 1 .039 
Fisher's ExactTest .080 .056 
Linear-by-Linear 3.879 1 .049 
Association 
N of Valid Cases 21 


FIGURE 12.6.1 SPSS output for Example 12.6.1. 


Various statistical software programs perform the calculations for the Fisher exact 
test. Figure 12.6.1 shows the results of Example 12.6.1 as computed by SPSS. The exact p 
value is provided for both a one-sided and a two-sided test. Based on these results, we fail to 
reject Но (p value 7.05), just as we did using the statistical tables in the Appendix. Note 
that in addition to the Fisher exact test several alternative tests are provided. The reader 
should be aware that these alternative tests are not appropriate if the assumptions under- 
lying them have been violated. 


EXERCISES 


a. Computed only for a 2 X 2 table 


b. 2 cells (50.096) have expected count less than 5. The minimum expected count is 4.29. 


12.6.1 The goal of a study by Tahmassebi and Curzon (A-13) was to determine if drooling in children 
with cerebral palsy is due to hypersalivation. One of the procedures toward that end was to examine 
the salivary buffering capacity of cerebral palsied children and controls. The following table gives 


the results. 


12.6.2 


12.6.3 
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Buffering Capacity 
Group Medium High 
Cerebral palsy 2 8 
Control 3 7 


Source: J. F. Tahmassebi and M. E. J. Curzon, “The Cause of Drooling in 
Children with Cerebral Palsy—Hypersalivation or Swallowing Defect?" 
International Journal of Paediatric Dentistry, 13 (2003), 106-111. 


Test for a significant difference between cerebral palsied children and controls with respect to high or 
low buffering capacity. Let o — .05 and find the p value. 


In a study by Xiao and Shi (A-14), researchers studied the effect of cranberry juice in the treatment 
and prevention of Helicobacter pylori infection in mice. The eradication of Helicobacter pylori 
results in the healing of peptic ulcers. Researchers compared treatment with cranberry juice to "triple 
therapy (amoxicillin, bismuth subcitrate, and metronidazole) in mice infected with Helicobacter 
pylori. After 4 weeks, they examined the mice to determine the frequency of eradication of the 
bacterium in the two treatment groups. The following table shows the results. 


No. of Mice with Helicobacter pylori Eradicated 


Yes No 
Triple therapy 8 2 
Cranberry juice 2 8 


Source: Shu Dong Xiao and Tong Shi, “Is Cranberry Juice Effective in the Treatment and 
Prevention of Helicobacter Pylori Infection of Mice," Chinese Journal of Digestive Diseases, 
4 (2003), 136-139. 


May we conclude, on the basis of these data, that triple therapy is more effective than cranberry juice 
at eradication of the bacterium? Let о = .05 and find the p value. 


In a study by Shaked et al. (A-15), researchers studied 26 children with blunt pancreatic injuries. 
These injuries occurred from a direct blow to the abdomen, bicycle handlebars, fall from height, or 
car accident. Nineteen of the patients were classified as having minor injuries, and seven were 
classified as having major injuries. Pseudocyst formation was suspected when signs of clinical 
deterioration developed, such as increased abdominal pain, epigastric fullness, fever, and increased 
pancreatic enzyme levels. In the major injury group, six of the seven children developed pseudocysts 
while in the minor injury group, three of the 19 children developed pseudocysts. Is this sufficient 
evidence to allow us to conclude that the proportion of children developing pseudocysts is higher in 
the major injury group than in the minor injury group? Let o — .01. 


12.7 RELATIVE RISK, ODDS RATIO, AND 
THE MANTEL-HAENSZEL STATISTIC 


In Chapter 8 we learned to use analysis of variance techniques to analyze data that arise 
from designed experiments, investigations in which at least one variable is manipulated 
in some way. Designed experiments, of course, are not the only sources of data that are 
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of interest to clinicians and other health sciences professionals. Another important class of 
scientific investigation that is widely used is the observational study. 


DEFINITION 

An observational study is a scientific investigation in which neither the 
subjects under study nor any of the variables of interest are manipulated 
in any way. 


An observational study, in other words, may be defined simply as an investigation 
that is not an experiment. The simplest form of observational study is one in which there are 
only two variables of interest. One of the variables is called the risk factor, or independent 
variable, and the other variable is referred to as the outcome, or dependent variable. 


DEFINITION 


The term risk factor is used to designate a variable that is thought to be 
related to some outcome variable. The risk factor may be a suspected 
cause of some specific state of the outcome variable. 


In a particular investigation, for example, the outcome variable might be subjects” 
status relative to cancer and the risk factor might be their status with respect to cigarette 
smoking. The model is further simplified if the variables are categorical with only two 
categories per variable. For the outcome variable the categories might be cancer present 
and cancer absent. With respect to the risk factor subjects might be categorized as smokers 
and nonsmokers. 

When the variables in observational studies are categorical, the data pertaining to 
them may be displayed in a contingency table, and hence the inclusion of the topic in the 
present chapter. We shall limit our discussion to the situation in which the outcome variable 
and the risk factor are both dichotomous variables. 


Types of Observational Studies There are two basic types of observational 
studies, prospective studies and retrospective studies. 


DEFINITION 


A prospective study is an observational study in which two random 
samples of subjects are selected. One sample consists of subjects who 
possess the risk factor, and the other sample consists of subjects who do 
not possess the risk factor. The subjects are followed into the future (that 
is, they are followed prospectively), and a record is kept on the number of 
subjects in each sample who, at some point in time, are classifiable into 
each of the categories of the outcome variable. 


The data resulting from a prospective study involving two dichotomous variables can 
be displayed in a 2 x 2 contingency table that usually provides information regarding the 
number of subjects with and without the risk factor and the number who did and did not 
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TABLE 12.7.1 Classification of a Sample of Subjects with Respect 
to Disease Status and Risk Factor 


Disease Status 


Risk Factor Present Absent Total at Risk 


Present a b a+b 
Absent с а c+d 
Total a+c b+ d n 


succumb to the disease of interest as well as the frequencies for each combination of 
categories of the two variables. 


DEFINITION 


A retrospective study is the reverse of a prospective study. The samples are 
selected from those falling into the categories of the outcome variable. 
The investigator then looks back (that is, takes a retrospective look) at the 
subjects and determines which ones have (or had) and which ones do not 
have (or did not have) the risk factor. 


From the data of a retrospective study we may construct a contingency table with 
frequencies similar to those that are possible for the data of a prospective study. 

In general, the prospective study is more expensive to conduct than the retrospective 
study. The prospective study, however, more closely resembles an experiment. 


Relative Risk The data resulting from a prospective study in which the dependent 
variable and the risk factor are both dichotomous may be displayed in a 2 x 2 contingency 
table such as Table 12.7.1. The risk of the development of the disease among the subjects 
with the risk factor is a/(a + b). The risk of the development of the disease among the 
subjects without the risk factor is c/(c + d). We define relative risk as follows. 


DEFINITION | 
Relative risk is the ratio of the risk of developing a disease among subjects 
with the risk factor to the risk of developing the disease among subjects 
without the risk factor. 


We represent the relative risk from a prospective study symbolically as 


= +b 
RR = at») (12.7.1) 
c/(c 4- d) 
where a, b, c, and d are as defined in Table 12.7.1, and RR indicates that the relative risk is 
computed from a sample to be used as an estimate of the relative risk, RR, for the 
population from which the sample was drawn. 
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We may construct a confidence interval for RR 


100(1 — a) %CI = Е! (6/7) (12.72) 


where z, is the two-sided z value corresponding to the chosen confidence coefficient and X? 
is computed by Equation 12.4.1. 


Interpretation of RR The value of RR may range anywhere between zero and 
infinity. A value of 1 indicates that there is no association between the status of the risk 
factor and the status of the dependent variable. In most cases the two possible states of 
the dependent variable are disease present and disease absent. We interpret an RR of 1 to 
mean that the risk of acquiring the disease is the same for those subjects with the risk 
factor and those without the risk factor. A value of RR greater than 1 indicates that the 
risk of acquiring the disease is greater among subjects with the risk factor than among 
subjects without the risk factor. An RR value that is less than 1 indicates less risk of 
acquiring the disease among subjects with the risk factor than among subjects without 
the risk factor. For example, a risk factor of 2 is taken to mean that those subjects with the 
risk factor are twice as likely to acquire the disease as compared to subjects without the 
risk factor. 
We illustrate the calculation of relative risk by means of the following example. 


EXAMPLE 12.7.1 


In a prospective study of pregnant women, Magann et al. (A-16) collected extensive 
information on exercise level of low-risk pregnant working women. A group of 217 women 
did no voluntary or mandatory exercise during the pregnancy, while a group of 238 women 
exercised extensively. One outcome variable of interest was experiencing preterm labor. 
The results are summarized in Table 12.7.2. 

We wish to estimate the relative risk of preterm labor when pregnant women exercise 
extensively. 


Solution: By Equation 12.7.1 we compute 


55 22/288 0924 _ 
18/217 — 0829 


TABLE 12.7.2 Subjects with and without the Risk Factor Who Became Cases 
of Preterm Labor 


1.1 


Risk Factor Cases of Preterm Labor Noncases of Preterm Labor Total 
Extreme exercising 22 216 238 
Not exercising 18 199 217 
Total 40 415 455 


Source: Everett F. Magann, Sharon F. Evans, Beth Weitz, and John Newnham, "Antepartum, Intrapartum, 
and Neonatal Significance of Exercise on Healthy Low-Risk Pregnant Working Women," Obstetrics and 
Gynecology, 99 (2002), 466-472. 
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Odds Ratio and Relative Risk Section 


Common Original Iterated Log Odds Relative 

Odds Ratio Odds Ratio Odds Ratio Ratio Risk 

Upper 95% C.L. 2.1350 2.2683 0.7585 2.1192 
1.1260 1.1207 1.1207 0.1140 1.1144 

Lower 9596 C.L. 0.5883 0.5606 —0.5305 0.5896 


FIGURE 12.7.1 NCSS output for the data in Example 12.7.1. 


These data indicate that the risk of experiencing preterm labor when a woman 
exercises heavily is 1.1 times as great as it is among women who do not 
exercise at all. 

We compute the 95 percent confidence interval for RR as follows. By 
Equation 12.4.1, we compute from the data in Table 12.7.2: 


_ 455(22)(199) — (216)(18)]> _ 
2 (40)(415) (238) (217) = .1274 


By Equation 12.7.2, the lower and upper confidence limits are, respectively, 


1,117196/V.174 — 65 and 1.11+196/V1274 — 1.86. Since the interval includes 
1, we conclude, at the .05 level of significance, that the population risk may 
be 1. In other words, we conclude that, in the population, there may not be 
an increased risk of experiencing preterm labor when a pregnant woman 
exercises extensively. 

The data were processed by NCSS. The results are shown in Figure 
12.7.1. The relative risk calculation is shown in the column at the far right of 
the output, along with the 95% confidence limits. Because of rounding errors, 
these values differ slightly from those given in the example. || 


Odds Ratio When the data to be analyzed come from a retrospective study, relative 
risk is not a meaningful measure for comparing two groups. As we have seen, a 
retrospective study is based on a sample of subjects with the disease (cases) and a separate 
sample of subjects without the disease (controls or noncases). We then retrospectively 
determine the distribution of the risk factor among the cases and controls. Given the results 
of a retrospective study involving two samples of subjects, cases, and controls, we may 
display the data in a 2 x 2 table such as Table 12.7.3, in which subjects are dichotomized 
with respect to the presence and absence of the risk factor. Note that the column headings in 
Table 12.7.3 differ from those in Table 12.7.1 to emphasize the fact that the data are from a 
retrospective study and that the subjects were selected because they were either cases or 
controls. When the data from a retrospective study are displayed as in Table 12.7.3, 
the ratio a/(a 4- b), for example, is not an estimate of the risk of disease for subjects with 
the risk factor. The appropriate measure for comparing cases and controls in a retrospective 
study is the odds ratio. As noted in Chapter 11, in order to understand the concept of 
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TABLE 12.7.3 Subjects of a Retrospective Study 
Classified According to Status Relativeto a Risk Factor 
and Whether They Are Cases or Controls 


Sample 
Risk Factor Cases Controls Total 
Present a b a+b 
Absent C d c+d 
Total a+c b+d n 


the odds ratio, we must understand the term odds, which is frequently used by those who 
place bets on the outcomes of sporting events or participate in other types of gambling 
activities. 


DEFINITION 


The odds for success are the ratio of the probability of success to the 
probability of failure. 


We use this definition of odds to define two odds that we can calculate from data 
displayed as in Table 12.7.3: 


1. The odds of being a case (having the disease) to being a control (not having the 
disease) among subjects with the risk factor is [a/(a + b)]/[b/(a + b)] = a/b. 

2. The odds of being a case (having the disease) to being a control (not having the 
disease) among subjects without the risk factor is [c/(c + d)]/|d/(c + d)] = c/d. 


We now define the odds ratio that we may compute from the data of a retrospective 
study. We use the symbol OR to indicate that the measure is computed from sample data 
and used as an estimate of the population odds ratio, OR. 


DEFINITION 
The estimate of the population odds ratio is 


— а/ь аа 


ОК = c/d = (12.7.3) 


where a, b, c, and d are as defined in Table 12.7.3. 


We may construct a confidence interval for OR by the following method: 


100(1 — о)! = ОВ" G«/VX') (12.7.4) 


where z, is the two-sided z value corresponding to the chosen confidence coefficient and 
X? is computed by Equation 12.4.1. 
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Interpretation of the Odds Ratio In the case of a rare disease, the popula- 
tion odds ratio provides a good approximation to the population relative risk. Conse- 
quently, the sample odds ratio, being an estimate of the population odds ratio, provides an 
indirect estimate of the population relative risk in the case of a rare disease. 

The odds ratio can assume values between zero and oo. A value of 1 indicates no 
association between the risk factor and disease status. A value less than 1 indicates reduced 
odds of the disease among subjects with the risk factor. A value greater than 1 indicates 
increased odds of having the disease among subjects in whom the risk factor is present. 


EXAMPLE 12.7.2 


Toschke et al. (A-17) collected data on obesity status of children ages 5-6 years and the 
smoking status of the mother during the pregnancy. Table 12.7.4 shows 3970 subjects 
classified as cases or noncases of obesity and also classified according to smoking status of 
the mother during pregnancy (the risk factor). We wish to compare the odds of obesity at 
ages 5-6 among those whose mother smoked throughout the pregnancy with the odds of 
obesity at age 5-6 among those whose mother did not smoke during pregnancy. 


Solution: The odds ratio is the appropriate measure for answering the question posed. 
By Equation 12.7.3 we compute 


—  (64)(3496) _ 
OR = cues 92 


We see that obese children (cases) are 9.62 times as likely as nonobese 
children (noncases) to have had a mother who smoked throughout the 
pregnancy. 

We compute the 95 percent confidence interval for OR as follows. By 
Equation 12.4.1 we compute from the data in Table 12.7.4 


„ _ 3970[(64) (3496) — (342)(68)]? 
(132) (3838)(406)(3564) 


TABLE 12.7.4 Subjects Classified According to Obesity 
Status and Mother's Smoking Status during Pregnancy 


— 217.6831 


Obesity Status 
Smoking Status Cases Noncases Total 
During Pregnancy 
Smoked throughout 64 342 406 
Never smoked 68 3496 3564 
Total 132 3838 3970 


Source: A. M. Toschke, S. M. Montgomery, U. Pfeiffer, and R. von Kries, "Early 
Intrauterine Exposure to Tobacco-Inhaled Products and Obesity," American Jour- 
nal of Epidemiology, 158 (2003), 1068-1074. 
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Smoking status * Obsesity status Cross-Tabulation 


Count 
Obesity status 
Cases Noncases Total 
Smoking. status Smoked throughout 64 342 406 
Never smoked 68 3496 3564 
Total 132 3838 3970 


Risk Estimate 


9596 Confidence 
Interval 

Value Lower Upper 
Odds Ratio for 
Smoking. status 
(Smoked throughout 9.621 6.719 13.775 
/Never smoked) 
For cohort Obesity . 8.262 5.966 11.441 
status — Cases 
For cohort Obesity . .859 .823 .896 
status = Noncases 
N of Valid Cases 3970 


FIGURE 12.7.2 SPSS output for Example 12.7.2. 


The lower and upper confidence limits for the population OR, respectively, are 
9.621-196/V21.651 — 7,12 and 9.621+196/V210.6851 — 13.00. We conclude 


with 95 percent confidence that the population OR is somewhere between 
7.12 and 13.00. Because the interval does notinclude 1, we conclude that, in the 
population, obese children (cases) are more likely than nonobese children 
(noncases) to have had a mother who smoked throughout the pregnancy. 
The data from Example 12.7.2 were processed using SPSS. The 
results are shown in Figure 12.7.2. The odds ratio calculation, along with 
the 9596 confidence limits, are shown in the top line of the Risk Estimate 
box. These values differ slightly from those in the example because of 
rounding error. BH 


The Mantel-Haenszel Statistic Frequently when we are studying the rela- 
tionship between the status of some disease and the status of some risk factor, we are 
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aware of another variable that may be associated with the disease, with the risk factor, 
or with both in such a way that the true relationship between the disease status and the 
risk factor is masked. Such a variable is called a confounding variable. For example, 
experience might indicate the possibility that the relationship between some disease 
and a suspected risk factor differs among different ethnic groups. We would then treat 
ethnic membership as a confounding variable. When they can be identified, it is 
desirable to control for confounding variables so that an unambiguous measure of the 
relationship between disease status and risk factor may be calculated. A technique for 
accomplishing this objective is the Mantel-Haenszel (22) procedure, so called in 
recognition of the two men who developed it. The procedure allows us to test the null 
hypothesis that there is no association between status with respect to disease and risk 
factor status. Initially used only with data from retrospective studies, the Mantel- 
Haenszel procedure is also appropriate for use with data from prospective studies, as 
discussed by Mantel (23). 

In the application of the Mantel-Haenszel procedure, case and control subjects are 
assigned to strata corresponding to different values of the confounding variable. The data 
are then analyzed within individual strata as well as across all strata. The discussion that 
follows assumes that the data under analysis are from a retrospective or a prospective study 
with case and noncase subjects classified according to whether they have or do not have the 
suspected risk factor. The confounding variable is categorical, with the different categories 
defining the strata. If the confounding variable is continuous it must be categorized. For 
example, if the suspected confounding variable is age, we might group subjects into 
mutually exclusive age categories. The data before stratification may be displayed as 
shown in Table 12.7.3. 

Application of the Mantel-Haenszel procedure consists of the following steps. 


1. Form k strata corresponding to the k categories of the confounding variable. Table 
12.7.5 shows the data display for the ith stratum. 


2. For each stratum compute the expected frequency e; of the upper left-hand cell of 
Table 12.7.5 as follows: 


M kai mI (12.75) 


пі 


TABLE 12.7.5 Subjects in the ith Stratum of a Confounding 
Variable Classified According to Status Relative to a Risk 
Factor and Whether They Are Cases or Controls 


Sample 
Risk Factor Cases Controls Total 
Present а; bi а; + bi 
Absent Cj d; са; 


Total aj + Cj bi 4 di пі 
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3. For each stratum compute 


(ai + bi)(ci + di)(ai + ci)(bi + di) 
п? (п; — 1) 


i 


(12.7.6) 


yj = 


4. Compute the Mantel-Haenszel test statistic, x25, as follows: 


хун = = ——— (12.77) 


5. Reject the null hypothesis of no association between disease status and suspected risk 
factor status in the population if the computed value of Xu is equal to or greater than 
the critical value of the test statistic, which is the tabulated chi-square value for 1 
degree of freedom and the chosen level of significance. 


Mantel-Haenszel Estimator of the Common Odds Ratio When we 
have k strata of data, each of which may be displayed in a table like Table 12.7.5, we may 
compute the Mantel-Haenszel estimator of the common odds ratio, ОЁмн as follows: 


М= 


(aidi/ni) 


Il 
MN 


ОЁмн = (12.7.8) 


М= 


(bici/n;) 


When we use the Mantel-Haenszel estimator given by Equation 12.7.4, we assume that, in 
the population, the odds ratio is the same for each stratum. 

We illustrate the use of the Mantel-Haenszel statistics with the following 
examples. 


EXAMPLE 12.7.3 


In a study by LaMont et al. (A-18), researchers collected data on obstructive coronary 
artery disease (OCAD), hypertension, and age among subjects identified by a treadmill 
stress test as being at risk. In Table 12.7.6, counts on subjects in two age strata are presented 
with hypertension as the risk factor and the presence of OCAD as the case/noncase 
variable. 


Solution: 


1. Data. See Table 12.7.6. 


2. Assumptions. We assume that the assumptions discussed earlier for the 
valid use of the Mantel-Haenszel statistic are met. 
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TABLE 12.7.6 Patients Stratified by Age and Classified by Status 
Relative to Hypertension (the Risk Factor) and OCAD (Case/Noncase 
Variable) 


Stratum 1 (55 and under) 


Risk Factor 

(Hypertension) Cases (OCAD) Noncases Total 
Present 21 11 32 
Absent 16 6 22 
Total 37 17 54 

Stratum 2 (over 55) 

Risk Factor 

(Hypertension) Cases (OCAD) Noncases Total 
Present 50 14 64 
Absent 18 6 24 
Total 68 20 88 


Source: Data provided courtesy of Matthew J. Budoff, MD. 


3. Hypotheses. 
Ho: There is no association between the presence of hypertension 
and occurrence of OCAD in subjects 55 and under and subjects 
over 55. 
Ha: There is a relationship between the two variables. 


4. Test statistic. 


NCESI 


¡=1 i=l 
XMH 


as given in Equation 12.7.7. 
5. Distribution of test statistic. Chi-square with 1 degree of freedom. 


6. Decision rule. Suppose we let е = .05. Reject Но if the computed value 
of the test statistic is greater than or equal to 3.841. 


7. Calculation of test statistic. By Equation 12.7.5 we compute the 
following expected frequencies: 


ey = (21 + 11)Q1 + 16)/54 = (32)(37) /54 = 21.93 
e; = (50 + 14)(50 + 18)/88 = (64)(68)/88 = 49.45 
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By Equation 12.7.6 we compute 


vı = (32)(22)(37)(17)/(2916)(54 — 1) = 2.87 
у» = (64)(24)(68)(20)/(7744)(88 — 1) = 3.10 


Finally, by Equation 12.7.7 we compute 


> [(21 + 50) — (21.93 + 49.45)? 
= = 0242 
Хмн 2.87 + 3.10 si 


8. Statistical decision. Since .0242 < 3.841, we fail to reject Ho. 


9. Conclusion. We conclude that there may not be an association between 
hypertension and the occurrence of OCAD. 


10. p value. Since .0242 < 2.706, the p value for this test is p > .10. 


We now illustrate the calculation of the Mantel-Haenszel estimator of the 
common odds ratio. "m 


EXAMPLE 12.7.4 


Let us refer to the data in Table 12.7.6 and compute the common odds ratio. 


Solution: From the stratified data in Table 12.7.6 we compute the numerator of the ratio 
as follows: 


(adi /n1) + (a2d2/n2) = |(21)(6)/54) + [(50)(6)/88] 
= 5.7424 


The denominator of the ratio is 


(bici /m) + (b2c2/n2) = [(11)(16)/54] + [(14)(18)/88] 
= 6.1229 


Now, by Equation 12.7.7, we compute the common odds ratio: 


5.7424 _ 


О 
ОКмн = 6.1259 


From these results we estimate that, regardless of age, patients who 
have hypertension are less likely to have OCAD than patients who do not 
have hypertension. mE 


Hand calculation of the Mantel-Haenszel test statistics can prove to be a cumber- 
some task. Fortunately, the researcher can find relief in one of several statistical software 
packages that are available. To illustrate, results from the use of SPSS to process the data of 
Example 12.7.3 are shown in Figure 12.7.3. These results differ from those given in the 
example because of rounding error. 
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Smoking status * Obsesity status * Stratum Cross-Tabulation 
Count 
Obesity status 
Stratum Cases |Noncases | Total 
55 and under Smoking status Smoked throughout 21 11 32 
Never smoked 16 6 22 
Total 37 17 54 
Over 55 Smoking status Smoked throughout 50 14 64 
Never smoked 18 6 24 
Total 68 20 88 
Tests of Conditional Independence 
Asymp. Sig. 

Chi-Squared df (2-sided) 

Cochran's .025 1 .875 

Mantel-Haenszel .002 1 .961 


Mantel-Haenszel Common Odds Ratio Estimate 


Estimate 

In(Estimate) 

Std. Error of In(Estimate) 
Asymp. Sig. (2-sided) 
Asymp. 9596 confidence 
Interval 


Common Odds 
Ratio 


In(Common) 
Odds Ratio) 


Lower Bound 
Upper Bound 


Lower Bound 
Upper Bound 


.938 
—.064 
.412 
.876 
.418 
2.102 


—.871 
.743 


FIGURE 12.7.3 SPSS output for Example 12.7.3. 


EXERCISES 


12.7.1 Davy et al. (A-19) reported the results of a study involving survival from cervical cancer. The 
researchers found that among subjects younger than age 50, 16 of 371 subjects had not survived for 
1 year after diagnosis. In subjects age 50 or older, 219 of 376 had not survived for 1 year after 
diagnosis. Compute the relative risk of death among subjects age 50 or older. Does it appear from 
these data that older subjects diagnosed as having cervical cancer are prone to higher mortality 


rates? 
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12.7.2 


12.7.3 


12.7.4 


12.7.5 


The objective of a prospective study by Stenestrand et al. (A-20) was to compare the mortality rate 
following an acute myocardial infarction (AMI) among subjects receiving early revascularization to 
the mortality rate among subjects receiving conservative treatments. Among 2554 patients receiving 
revascularization within 14 days of AMI, 84 died in the year following the AMI. In the conservative 
treatment group (risk factor present), 1751 of 19,358 patients died within a year of AMI. Compute the 
relative risk of mortality in the conservative treatment group as compared to the revascularization 
group in patients experiencing AMI. 


Refer to Example 12.7.2. Toschke et al. (A-17), who collected data on obesity status of children ages 
5-6 years and the smoking status of the mother during the pregnancy, also reported on another 
outcome variable: whether the child was born premature (37 weeks or fewer of gestation). The 
following table summarizes the results of this aspect of the study. The same risk factor (smoking 
during pregnancy) is considered, but a case is now defined as a mother who gave birth prematurely. 


Premature Birth Status 


Smoking Status 

During Pregnancy Cases Noncases Total 
Smoked throughout 36 370 406 
Never smoked 168 3396 3564 
Total 204 3766 3970 


Source: A. M. Toschke, S. M. Montgomery, U. Pfeiffer, and R. von Kries, “Early Intrauterine 
Exposure to Tobacco-Inhaled Products and Obesity," American Journal of Epidemiology, 158 
(2003), 1068-1074. 


Compute the odds ratio to determine if smoking throughout pregnancy is related to premature birth. 
Use the chi-square test of independence to determine if one may conclude that there is an association 
between smoking throughout pregnancy and premature birth. Let о = .05. 


Sugiyama et al. (A-21) examined risk factors for allergic diseases among 13- and 14-year-old 
schoolchildren in Japan. One risk factor of interest was a family history of eating an unbalanced diet. 
The following table shows the cases and noncases of children exhibiting symptoms of rhinitis in the 
presence and absence of the risk factor. 


Rhinitis 
Family History Cases Noncases Total 
Unbalanced diet 656 1451 2107 
Balanced diet 677 1662 2339 
Total 1333 3113 4446 


Source: Takako Sugiyama, Kumiya Sugiyama, Masao Toda, Tastuo Yukawa, Sohei Makino, 
and Takeshi Fukuda, “Risk Factors for Asthma and Allergic Diseases Among 13-14-Year-Old 
Schoolchildren in Japan," Allergology International, 51 (2002), 139—150. 


What is the estimated odds ratio of having rhinitis among subjects with a family history of an 
unbalanced diet compared to those eating a balanced diet? Compute the 95 percent confidence 
interval for the odds ratio. 

According to Holben et al. (A-22), “Food insecurity implies a limited access to or availability of food 
or a limited/uncertain ability to acquire food in socially acceptable ways." These researchers 
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collected data on 297 families with a child in the Head Start nursery program in a rural area of Ohio 
near Appalachia. The main outcome variable of the study was household status relative to food 
security. Households that were not food secure are considered to be cases. The risk factor of interest 
was the absence of a garden from which a household was able to supplement its food supply. In the 
following table, the data are stratified by the head of household's employment status outside the 


home. 
Stratum 1 (Employed Outside the Home) 
Risk Factor Cases Noncases Total 
No garden 40 3T TI 
Garden 13 38 51 
Total 53 75 128 
Stratum 2 (Not Employed Outside the Home) 

Risk Factor Cases Noncases Total 
No garden 75 38 113 
Garden 15 33 48 
Total 90 71 161 


Source: Data provided courtesy of David Н. Holben, Ph.D. and John P. Holcomb, Jr., Ph.D. 


Compute the Mantel-Haenszel common odds ratio with stratification by employment status. Use the 
Mantel-Haenszel chi-square test statistic to determine if we can conclude that there is an association 
between the risk factor and food insecurity. Let a = .05. 


12.8 SUMMARY 


In this chapter some uses of the versatile chi-square distribution are discussed. Chi-square 
goodness-of-fit tests applied to the normal, binomial, and Poisson distributions are 
presented. We see that the procedure consists of computing a statistic 


к-у E a 


that measures the discrepancy between the observed (O;) and expected (E;) frequencies of 
occurrence of values in certain discrete categories. When the appropriate null hypothesis is 
true, this quantity is distributed approximately as x^. When X? is greater than or equal to the 
tabulated value of х2 for some а, the null hypothesis is rejected at the o level of 
significance. 

Tests of independence and tests of homogeneity are also discussed in this chapter. 
The tests are mathematically equivalent but conceptually different. Again, these tests 
essentially test the goodness-of-fit of observed data to expectation under hypotheses, 
respectively, of independence of two criteria of classifying the data and the homogeneity of 
proportions among two or more groups. 
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In addition, we discussed and illustrated in this chapter four other techniques for 
analyzing frequency data that can be presented in the form of a2 x 2 contingency table: the 
Fisher exact test, the odds ratio, relative risk, and the Mantel-Haenszel procedure. Finally, 
we discussed the basic concepts of survival analysis and illustrated the computational 
procedures by means of two examples. 


SUMMARY OF FORMULAS FOR CHAPTER 12 


Formula 
Number Name Formula 
12.2.1 Standard normal random зон 
variable с 
12.2.2 Chi-square distribution with Xin) = 2 sb © ИТЕ 2 
n degrees of freedom 
12.2.3 Chi-square probability fire 1 d (k/2)-1,5- (u/2) 
density function k 1 Qu 
2 
i- isti 2 
12.2.4 Chi-square test statistic "T" (0; — E;) 
O E 
12.4.1 Chi-square calculation 5 пад — bc)? 
formula for a 2 x 2 x (a+c)(b+d)(a+b)(c +d) 
contingency table 
12.4.2 Yates’s corrected chi-square 5 n(|ad — bc| — 5n) 
calculation for a 2 x 2 Xcorrected — (а + c)(b + día + Б)(с4 
contingency table 
12.6.1-12.6.2 Large-sample approximation _ (а/А) — (Ь/В) 
to the chi-square МР — Р)(1/А + 1/B) 
where 
p = (a + b)/(A + B) 
12.7.1 Relative risk estimate fü a/ (a 4- b) 
— с/с-а) 
12.7.2 Confidence interval for the 100(1 — a) %CI = RRIEGU V) 
relative risk estimate 
12.7.3 Odds ratio estimate OR = a/b ad 
оса be 
12.7.4 Confidence interval for the 100(1 — 1) %CI = OR (v) 
odds ratio estimate 


(Continued ) 
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12.7.5 Expected frequency in the _ (a; + bi)(ai + ci) 
Mantel-Haenszel statistic aS nj 
12.7.6 Stratum expected frequency _ (ai + bi)(ci а) (а + ci)(bi + di) 
in the Mantel-Haenszel "i n?(nj -1) 
statistic 
12.7.7 Mantel—Haenszel test statistic k k 
2,4 — >) ei 
2  Ni-l i=l 
XMH = k 
Уи 
¡=1 
12.7.8 Mantel-Haenszel estimator k 
of the common odds ratio E 2 (ага, /т:) 
ОКмн = | 
2 (bici/ni) 
Symbol Key * a, b, c, d = cell frequencies in a2 x 2contingency table 


* A, B — row totals in the2 x 2contingency table 

* 8 = regression coefficient 

• x (orX?) — chi-square 

* e; — expected frequency in the Mantel-Haenszel statistic 
* E; — expected frequency 

. Еу) = expected value of y atx 

* k — degrees of freedom in the chi-square distribution 

* u = mean 

* О; = observed frequency 

* OR — odds ratio estimate 

* о = standard deviation 

e RR = relative risk estimate 

є у; = stratum expected frequency in the Mantel-Haenszel statistic 
є y; = data value at point i 

* z — normal variate 


REVIEW QUESTIONS AND EXERCISES 


Explain how the chi-square distribution may be derived. 

What are the mean and variance of the chi-square distribution? 

Explain how the degrees of freedom are computed for the chi-square goodness-of-fit tests. 
State Cochran's rule for small expected frequencies in goodness-of-fit tests. 

How does one adjust for small expected frequencies? 


What is a contingency table? 


гї т 0% Es AA ib» em 


How are the degrees of freedom computed when an X? value is computed from a contingency 
table? 
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8. Explain the rationale behind the method of computing the expected frequencies in a test of 
independence. 


9. Explain the difference between a test of independence and a test of homogeneity. 


10. Explain the rationale behind the method of computing the expected frequencies in a test of 
homogeneity. 


11. When do researchers use the Fisher exact test rather than the chi-square test? 


12. Define the following: 


(a) Observational study (b) Risk factor 

(c) Outcome (d) Retrospective study 
(e) Prospective study (f) Relative risk 

(g) Odds (h) Odds ratio 


(i) Confounding variable 


13. Under what conditions is the Mantel-Haenszel test appropriate? 


14. Explain how researchers interpret the following measures: 
(a) Relative risk 
(b) Odds ratio 
(c) Mantel-Haenszel common odds ratio 


15. In a study of violent victimization of women and men, Porcerelli et al. (A-23) collected infor- 
mation from 679 women and 345 men ages 18 to 64 years at several family practice centers 
in the metropolitan Detroit area. Patients filled out a health history questionnaire that included 
a question about victimization. The following table shows the sample subjects cross-classified 
by gender and the type of violent victimization reported. The victimization categories are 
defined as no victimization, partner victimization (and not by others), victimization by a person 
other than a partner (friend, family member, or stranger), and those who reported multiple 
victimization. 


Gender No Victimization | Partner Nonpartner Multiple Total 


Women 611 34 16 18 679 
Men 308 10 17 10 345 
Total 919 44 33 28 1024 


Source: John H. Porcerelli, Rosemary Cogan, Patricia P. West, Edward A. Rose, Dawn 
Lambrecht, Karen E. Wilson, Richard K. Severson, and Dunia Karana, “Violent Victimization 
of Women and Men: Physical and Psychiatric Symptoms," Journal of the American Board of 
Family Practice, 16 (2003), 32-39. 


Can we conclude on the basis of these data that victimization status and gender are not independent? 
Let a = .05. 


16. Refer to Exercise 15. The following table shows data reported by Porcerelli et al. for 644 African- 
American and Caucasian women. May we conclude on the basis of these data that for women, race 
and victimization status are not independent? Let a = .05. 


17. 


18. 


19. 
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No Victimization Partner Nonpartner Multiple Total 
Caucasian 356 20 3 9 388 
African-American 226 11 10 9 256 
Total 582 31 13 18 644 


Source: John H. Porcerelli, Rosemary Cogan, Patricia P. West, Edward A. Rose, Dawn Lambrecht, 
Karen E. Wilson, Richard K. Severson, and Dunia Karana, “Violent Victimization of Women and 
Men: Physical and Psychiatric Symptoms,” Journal of the American Board of Family Practice, 16 
(2003), 32-39. 
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A sample of 150 chronic carriers of a certain antigen and a sample of 500 noncarriers revealed the 


following blood group distributions: 


Blood Group Carriers Noncarriers Total 
0 72 230 302 
A 54 192 246 
B 16 63 79 
AB 8 15 23 
Total 150 500 650 


Can one conclude from these data that the two populations from which the samples were drawn differ 


with respect to blood group distribution? Let o — .05. What is the p value for the test? 


The following table shows 200 males classified according to social class and headache status: 


Social Class 


Headache Group A B С Total 
No headache (in previous year) 6 30 22 58 
Simple headache 11 35 17 63 
Unilateral headache (nonmigraine) 4 19 14 37 
Migraine 5 25 12 42 
Total 26 109 65 200 


Do these data provide sufficient evidence to indicate that headache status and social class are related? 


Let o = .05. What is the p value for this test? 


The following is the frequency distribution of scores made on an aptitude test by 175 applicants to a 
physical therapy training facility (x = 39.71, s = 12.92). 


Number of Applicants Number of Applicants 


28 


15-19 8 45—49 20 
20-24 13 50-54 18 
25-29 17 55-59 12 


(Continued ) 
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20. 


21. 


22. 


Score Number of Applicants Score Number of Applicants 
30-34 19 60-64 8 
35-39 25 65-69 4 
Total 175 


Do these data provide sufficient evidence to indicate that the population of scores is not normally 
distributed? Let a = .05. What is the p value for this test? 


A local health department sponsored a venereal disease (VD) information program that was open to 
high-school juniors and seniors who ranged in age from 16 to 19 years. The program director believed 
that each age level was equally interested in knowing more about VD. Since each age level was about 
equally represented in the area served, she felt that equal interest in VD would be reflected by equal 
age-level attendance at the program. The age breakdown of those attending was as follows: 


Age Number Attending 
16 26 
17 50 
18 44 
19 40 


Are these data incompatible with the program director's belief that students in the four age levels are 
equally interested in VD? Let a = .05. What is the p value for this test? 


A survey of children under 15 years of age residing in the inner-city area of a large city were classified 
according to ethnic group and hemoglobin level. The results were as follows: 


Hemoglobin Level (g/100 ml) 


Ethnic Group 10.0 or Greater 9.0-9.9 « 9.0 Total 
A 80 100 20 200 
B 99 190 96 385 
С 70 30 10 110 
Total 249 320 126 695 


Do these data provide sufficient evidence to indicate, at the .05 level of significance, that the two 
variables are related? What is the p value for this test? 


A sample of reported cases of mumps in preschool children showed the following distribution by age: 


Age (Years) Number of Cases 
Under 1 6 
1 20 
2 35 
3 41 
4 48 


Total 150 


23. 


24. 


25. 


26. 


27. 


28. 


29. 


REVIEW QUESTIONS AND EXERCISES 661 


Test the hypothesis that cases occur with equal frequency in the five age categories. Let о = .05. 
What is the p value for this test? 


Each of a sample of 250 men drawn from a population of suspected joint disease victims was asked 
which of three symptoms bother him most. The same question was asked of a sample of 300 
suspected women joint disease victims. The results were as follows: 


Most Bothersome Symptom Men Women 
Morning stiffness 111 102 
Nocturnal pain 59 73 
Joint swelling 80 125 
Total 250 300 


Do these data provide sufficient evidence to indicate that the two populations are not homogeneous 
with respect to major symptoms? Let œ = .05. What is the p value for this test? 


For each of the Exercises 24 through 34, indicate whether a null hypothesis of homogeneity or a null 
hypothesis of independence is appropriate. 


A researcher wishes to compare the status of three communities with respect to immunity against polio 
in preschool children. A sample of preschool children was drawn from each of the three communities. 


In a study of the relationship between smoking and respiratory illness, a random sample of adults 
were classified according to consumption of tobacco and extent of respiratory symptoms. 


A physician who wished to know more about the relationship between smoking and birth defects 
studies the health records of a sample of mothers and their children, including stillbirths and 
spontaneously aborted fetuses where possible. 


A health research team believes that the incidence of depression is higher among people with 
hypoglycemia than among people who do not suffer from this condition. 


In a simple random sample of 200 patients undergoing therapy at a drug abuse treatment center, 
60 percent belonged to ethnic group I. The remainder belonged to ethnic group II. In ethnic group I, 
60 were being treated for alcohol abuse (A), 25 for marijuana abuse (B), and 20 for abuse of heroin, 
illegal methadone, or some other opioid (C). The remainder had abused barbiturates, cocaine, 
amphetamines, hallucinogens, or some other nonopioid besides marijuana (D). In ethnic group II the 
abused drug category and the numbers involved were as follows: 


A(28) B(32) C(13) D (the remainder) 


Can one conclude from these data that there is a relationship between ethnic group and choice of drug 
to abuse? Let œ = .05 and find the p value. 


Solar keratoses are skin lesions commonly found on the scalp, face, backs of hands, forearms, ears, 
scalp, and neck. They are caused by long-term sun exposure, but they are not skin cancers. Chen et al. 
(A-24) studied 39 subjects randomly assigned (with a 3 to 1 ratio) to imiquimod cream and a control 
cream. The criterion for effectiveness was having 75 percent or more of the lesion area cleared after 
14 weeks of treatment. There were 21 successes among 29 imiquimod-treated subjects and three 
successes among 10 subjects using the control cream. The researchers used Fisher's exact test and 
obtained a p value of .027. What are the variables involved? Are the variables quantitative or 
qualitative? What null and alternative hypotheses are appropriate? What are your conclusions? 
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30. 


31. 


32. 


33. 


34. 


Janardhan et al. (A-25) examined 125 patients who underwent surgical or endovascular treatment for 
intracranial aneurysms. At 30 days postprocedure, 17 subjects experienced transient/persistent 
neurological deficits. The researchers performed logistic regression and found that the 95 percent 
confidence interval for the odds ratio for aneurysm size was .09—.96. Aneurysm size was dichoto- 
mized as less than 13 mm and greater than or equal to 13 mm. The larger tumors indicated higher odds 
of deficits. Describe the variables as to whether they are continuous, discrete, quantitative, or 
qualitative. What conclusions may be drawn from the given information? 


Inastudy of smoking cessation by Gold et al. (A-26), 189 subjects self-selected into three treatments: 
nicotine patch only (NTP), Bupropion SR only (B), and nicotine patch with Bupropion SR 
(NTP 4- B). Subjects were grouped by age into younger than 50 years old, between 50 and 64, 
and 65 and older. There were 15 subjects younger than 50 years old who chose NTP, 26 who chose B, 
and 16 who chose NTP 4- B. In the 50-64 years category, six chose NTP, 54 chose B, and 40 chose 
NTP + B. In the oldest age category, six chose NTP, 21 chose B, and five chose NTP + B. What 
statistical technique studied in this chapter would be appropriate for analyzing these data? Describe 
the variables involved as to whether they are continuous, discrete, quantitative, or qualitative. What 
null and alternative hypotheses are appropriate? If you think you have sufficient information, conduct 
a complete hypothesis test. What are your conclusions? 


Kozinszky and Bártai (A-27) examined contraceptive use by teenage girls requesting abortion in 
Szeged, Hungary. Subjects were classified as younger than 20 years old or 20 years old or older. Of 
the younger than 20-year-old women, 146 requested an abortion. Of the older group, 1054 requested 
an abortion. A control group consisted of visitors to the family planning center who did not request an 
abortion or persons accompanying women who requested an abortion. In the control group, there 
were 147 women under 20 years of age and 1053 who were 20 years or older. One of the outcome 
variables of interest was knowledge of emergency contraception. The researchers report that, 
“Emergency contraception was significantly [(Mantel-Haenszel) p « .001] less well known among 
the would-be aborter teenagers as compared to the older women requesting artificial abortion 
(OR = .07) than the relevant knowledge of the teenage controls (OR — .10)." Explain the meaning 
of the reported statistics. What are your conclusions based on the given information? 


The goal of a study by Crosignani et al. (A-28) was to assess the effect of road traffic exhaust on the 
risk of childhood leukemia. They studied 120 children in Northern Italy identified through a 
population-based cancer registry (cases). Four controls per case, matched by age and gender, were 
sampled from population files. The researchers used a diffusion model of benzene to estimate 
exposure to traffic exhaust. Compared to children whose homes were not exposed to road traffic 
emissions, the rate of childhood leukemia was significantly higher for heavily exposed children. 
Characterize this study as to whether it is observational, prospective, or retrospective. Describe the 
variables as to whether they are continuous, discrete, quantitative, qualitative, a risk factor, or a 
confounding variable. Explain the meaning of the reported results. What are your conclusions based 
on the given information? 


Gallagher et al. (A-29) conducted a descriptive study to identify factors that influence women's 
attendance at cardiac rehabilitation programs following a cardiac event. One outcome variable of 
interest was actual attendance at such a program. The researchers enrolled women discharged from 
four metropolitan hospitals in Sydney, Australia. Of 183 women, only 57 women actually attended 
programs. The authors reported odds ratios and confidence intervals on the following variables that 
significantly affected outcome: age-squared (1.72; 1.10—2.70). Women over the age of 70 had the 
lowest odds, while women ages 55—70 years had the highest odds.), perceived control (.92; .85—1.00), 
employment (.20; .07-.58), diagnosis (6.82, 1.84-25.21, odds ratio was higher for women who 
experienced coronary artery bypass grafting vs. myocardial infarction), and stressful event (.21, .06—.73). 
Characterize this study as to whether it is observational, prospective, or retrospective. Describe the 
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variables as to whether they are continuous, discrete, quantitative, qualitative, a risk factor, or a 
confounding variable. Explain the meaning of the reported odds ratios. 


For each of the Exercises 35 through 51, do as many of the following as you think appropriate: 


(a) Apply one or more of the techniques discussed in this chapter. 

(b) Apply one or more of the techniques discussed in previous chapters. 

(c) Construct graphs. 

(d) Construct confidence intervals for population parameters. 

(e) Formulate relevant hypotheses, perform the appropriate tests, and find p values. 

(f) State the statistical decisions and clinical conclusions that the results of your hypothesis tests justify. 
(g) Describe the population(s) to which you think your inferences are applicable. 

(h) State the assumptions necessary for the validity of your analyses. 

In a prospective, randomized, double-blind study, Stanley et al. (A-30) examined the relative efficacy 
and side effects of morphine and pethidine, drugs commonly used for patient-controlled analgesia 
(PCA). Subjects were 40 women, between the ages of 20 and 65 years, undergoing total abdominal 
hysterectomy. Patients were allocated randomly to receive morphine or pethidine by PCA. At the end 


of the study, subjects described their appreciation of nausea and vomiting, pain, and satisfaction by 
means of a three-point verbal scale. The results were as follows: 


Satisfaction 
Unhappy/ Moderately Happy/ 
Drug Miserable Happy Delighted Total 
Pethidine 5 9 6 20 
Morphine 9 9 2 20 
Total 14 18 8 40 
Pain 

Unbearable/ Slight/ 
Drug Severe Moderate None Total 
Pethidine 2 10 8 20 
Morphine 2 8 10 20 
Total 4 18 18 40 

Nausea 

Unbearable/ Slight/ 
Drug Severe Moderate None Total 
Pethidine 5 9 6 20 
Morphine 7 8 5 20 
Total 12 17 11 40 


Source: Data provided courtesy of Dr. Balraj L. Appadu. 
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Screening data from a statewide lead poisoning prevention program between April 1990 and March 
1991 were examined by Sargent et al. (A-31) in an effort to learn more about community risk factors 
for iron deficiency in young children. Study subjects ranged in age between 6 and 59 months. 
Among 1860 children with Hispanic surnames, 338 had iron deficiency. Four-hundred-fifty-seven 
of 1139 with Southeast Asian surnames and 1034 of 8814 children with other surnames had iron 
deficiency. 


To increase understanding of HIV-infection risk among patients with severe mental illness, Horwath 
et al. (A-32) conducted a study to identify predictors of injection drug use among patients who did not 
have a primary substance use disorder. Of 192 patients recruited from inpatient and outpatient public 
psychiatric facilities, 123 were males. Twenty-nine of the males and nine of the females were found 
to have a history of illicit-drug injection. 


Skinner et al. (A-33) conducted a clinical trial to determine whether treatment with melphalan, 
prednisone, and colchicine (MPC) is superior to colchicine (C) alone. Subjects consisted of 100 
patients with primary amyloidosis. Fifty were treated with C and 50 with MPC. Eighteen months 
after the last person was admitted and 6 years after the trial began, 44 of those receiving C and 36 of 
those receiving MPC had died. 


The purpose of a study by Miyajima et al. (A-34) was to evaluate the changes of tumor cell 
contamination in bone marrow (BM) and peripheral blood (PB) during the clinical course of patients 
with advanced neuroblastoma. Their procedure involved detecting tyrosine hydroxylase (TH) mRNA 
to clarify the appropriate source and time for harvesting hematopoietic stem cells for transplantation. 
The authors used Fisher's exact test in the analysis of their data. If available, read their article and 
decide if you agree that Fisher's exact text was the appropriate technique to use. If you agree, 
duplicate their procedure and see if you get the same results. If you disagree, explain why. 


Cohen et al. (A-35) investigated the relationship between HIV seropositivity and bacterial vaginosis 
in a population at high risk for sexual acquisition of HIV. Subjects were 144 female commercial sex 
workers in Thailand of whom 62 were HIV-positive and 109 had a history of sexually transmitted 
diseases (STD). In the HIV-negative group, 51 had a history of STD. 


The purpose of a study by Lipschitz et al. (A-36) was to examine, using a questionnaire, the rates and 
characteristics of childhood abuse and adult assaults in a large general outpatient population. 
Subjects consisted of 120 psychiatric outpatients (86 females, 34 males) in treatment at a large 
hospital-based clinic in an inner-city area. Forty-seven females and six males reported incidents of 
childhood sexual abuse. 


Subjects of a study by O'Brien et al. (A-37) consisted of 100 low-risk patients having well-dated 
pregnancies. The investigators wished to evaluate the efficacy of a more gradual method for 
promoting cervical change and delivery. Half of the patients were randomly assigned to receive 
a placebo, and the remainder received 2 mg of intravaginal prostaglandin E, (PGE;) for 5 consecutive 
days. One of the infants born to mothers in the experimental group and four born to those in the 
control group had macrosomia. 


The purposes of a study by Adra et al. (A-38) were to assess the influence of route of delivery on 
neonatal outcome in fetuses with gastroschisis and to correlate ultrasonographic appearance of the 
fetal bowel with immediate postnatal outcome. Among 27 cases of prenatally diagnosed gastro- 
schisis the ultrasonograph appearance of the fetal bowel was normal in 15. Postoperative complica- 
tions were observed in two of the 15 and in seven of the cases in which the ultrasonographic 
appearance was not normal. 


Liu et al. (A-39) conducted household surveys in areas of Alabama under tornado warnings. In one of 
the surveys (survey 2) the mean age of the 193 interviewees was 54 years. Of these 56.0 percent were 
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women, 88.6 percent were white, and 83.4 percent had a high-school education or higher. Among 
the information collected were data on shelter-seeking activity and understanding of the term 
"tornado warning." One-hundred-twenty-eight respondents indicated that they usually seek 
shelter when made aware of a tornado warning. Of these, 118 understood the meaning of tornado 
warning. Forty-six of those who said they didn't usually seek shelter understood the meaning 
of the term. 


The purposes of a study by Patel et al. (A-40) were to investigate the incidence of acute angle-closure 
glaucoma secondary to pupillary dilation and to identify screening methods for detecting angles at 
risk of occlusion. Of 5308 subjects studied, 1287 were 70 years of age or older. Seventeen of the older 
subjects and 21 of the younger subjects (40 through 69 years of age) were identified as having 
potentially occludable angles. 


Voskuyl et al. (A-41) investigated those characteristics (including male gender) of patients with 
rheumatoid arthritis (RA) that are associated with the development of rheumatoid vasculitis (RV). 
Subjects consisted of 69 patients who had been diagnosed as having RV and 138 patients with RA 
who were not suspected to have vasculitis. There were 32 males in the RV group and 38 among the 
RA patients. 


Harris et al. (A-42) conducted a study to compare the efficacy of anterior colporrhaphy and 
retropubic urethropexy performed for genuine stress urinary incontinence. The subjects were 76 
women who had undergone one or the other surgery. Subjects in each group were comparable in age, 
social status, race, parity, and weight. In 22 of the 41 cases reported as cured the surgery had been 
performed by attending staff. In 10 of the failures, surgery had been performed by attending staff. All 
other surgeries had been performed by resident surgeons. 


Kohashi et al. (A-43) conducted a study in which the subjects were patients with scoliosis. As part of 
the study, 21 patients treated with braces were divided into two groups, group A(na = 12) and group 
B(ng = 9), on the basis of certain scoliosis progression factors. Two patients in group A and eight in 
group B exhibited evidence of progressive deformity, while the others did not. 


In a study of patients with cervical intraepithelial neoplasia, Burger et al. (A-44) compared those who 
were human papillomavirus (HPV)-positive and those who were HPV-negative with respect to risk 
factors for HPV infection. Among their findings were 60 out of 91 nonsmokers with HPV infection 
and 44 HPV-positive patients out of 50 who smoked 21 or more cigarettes per day. 


Thomas et al. (A-45) conducted a study to determine the correlates of compliance with follow-up 
appointments and prescription filling after an emergency department visit. Among 235 respondents, 
158 kept their appointments. Of these, 98 were females. Of those who missed their appointments, 31 
were males. 


The subjects of a study conducted by O’ Keefe and Lavan (A-46) were 60 patients with cognitive 
impairment who required parenteral fluids for at least 48 hours. The patients were randomly assigned 
to receive either intravenous (IV) or subcutaneous (SC) fluids. The mean age of the 30 patients in the 
SC group was 81 years with a standard deviation of 6. Fifty-seven percent were females. The mean 
age of the IV group was 84 years with a standard deviation of 7. Agitation related to the cannula or 
drip was observed in 11 of the SC patients and 24 of the IV patients. 


Exercises for Use with the Large Data Sets Available on the Following Website: 
www.wiley.com/college/daniel 


Refer to the data on smoking, alcohol consumption, blood pressure, and respiratory disease among 
1200 adults (SMOKING). The variables are as follows: 


666 CHAPTER 12 THE CHI-SQUARE DISTRIBUTION AND THE ANALYSIS OF FREQUENCIES 


male, 0 — female 

= nonsmoker, 1 = smoker 
= nondrinker 

light to moderate drinker 
— heavy drinker 

= present, O — absent 

= present, O — absent 


Sex (А): 
Smoking status (B) : 
Drinking level (C) : 


Symptoms of respiratory disease (D) : 
High blood pressure status (E) : 


ИИГЕ „Жыш 
Il 


Select a simple random sample of size 100 from this population and carry out an analysis to see if you 
can conclude that there is a relationship between smoking status and symptoms of respiratory disease. 
Let о = .05 and determine the p value for your test. Compare your results with those of your 
classmates. 


Refer to Exercise 1. Select a simple random sample of size 100 from the population and carry out a 
test to see if you can conclude that there is a relationship between drinking status and high blood 
pressure status in the population. Let = .05 and determine the p value. Compare your results with 
those of your classmates. 


Refer to Exercise 1. Select a simple random sample of size 100 from the population and carry out a 
test to see if you can conclude that there is a relationship between gender and smoking status in the 
population. Let œ = .05 and determine the p value. Compare your results with those of your 
classmates. 


Refer to Exercise 1. Select a simple random sample of size 100 from the population and carry out a 
test to see if you can conclude that there is a relationship between gender and drinking level in the 
population. Let о = .05 and find the p value. Compare your results with those of your classmates. 
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NONPARAMETRIC AND 
DISTRIBUTION-FREE 
STATISTICS 


CHAPTER OVERVIEW 


This chapter explores a wide variety of techniques that are useful when the 
underlying assumptions of traditional hypothesis tests are violated or one 
wishes to perform a test without making assumptions about the sampled 
population. 


TOPICS 


13.1 INTRODUCTION 
13.2 MEASUREMENT SCALES 
13.3 THE SIGN TEST 
13.4 THE WILCOXON SIGNED-RANK TEST FOR LOCATION 
13.5 THE MEDIAN TEST 
13.6 THE MANN-WHITNEY TEST 
13.7 THE KOLMOGOROV-SMIRNOV GOODNESS-OF-FIT TEST 
13.8 THE KRUSKAL-WALLIS ONE-WAY ANALYSIS OF VARIANCE BY RANKS 
13.9 THE FRIEDMAN TWO-WAY ANALYSIS OF VARIANCE BY RANKS 
13.10 THE SPEARMAN RANK CORRELATION COEFFICIENT 
13.11 NONPARAMETRIC REGRESSION ANALYSIS 
13.12 SUMMARY 


LEARNING OUTCOMES 


After studying this chapter, the student will 


1. understand the rank transformation and how nonparametric procedures can be 
used for weak measurement scales. 
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2. beableto calculate and interpret a wide variety of nonparametric tests commonly 
used in practice. 


3. understand which nonparametric tests may be used in place of traditional para- 
metric statistical tests when various test assumptions are violated. 


13.1 INTRODUCTION 


Most of the statistical inference procedures we have discussed up to this point are classified 
as parametric statistics. One exception is our use of chi-square—as a test of goodness-of-fit 
and as a test of independence. These uses of chi-square come under the heading of 
nonparametric statistics. 

The obvious question now is, “What is the difference?” In answer, let us recall the 
nature of the inferential procedures that we have categorized as parametric. In each case, our 
interest was focused on estimating or testing a hypothesis about one or more population 
parameters. Furthermore, central to these procedures was a knowledge of the functional form 
of the population from which were drawn the samples providing the basis for the inference. 

An example of a parametric statistical test is the widely used t test. The most common 
uses of this test are for testing a hypothesis about a single population mean or the difference 
between two population means. One of the assumptions underlying the valid use of this test 
is that the sampled population or populations are at least approximately normally 
distributed. 

As we will learn, the procedures that we discuss in this chapter either are not 
concerned with population parameters or do not depend on knowledge of the sampled 
population. Strictly speaking, only those procedures that test hypotheses that are not 
statements about population parameters are classified as nonparametric, while those that 
make no assumption about the sampled population are called distribution-free procedures. 
Despite this distinction, it is customary to use the terms nonparametric and distribution- 
free interchangeably and to discuss the various procedures of both types under the heading 
nonparametric statistics. We will follow this convention. 

The above discussion implies the following four advantages of nonparametric 
statistics. 


1. They allow for the testing of hypotheses that are not statements about population 
parameter values. Some of the chi-square tests of goodness-of-fit and the tests of 
independence are examples of tests possessing this advantage. 


2. Nonparametric tests may be used when the form of the sampled population is 
unknown. 


3. Nonparametric procedures tend to be computationally easier and consequently more 
quickly applied than parametric procedures. This can be a desirable feature in certain 
cases, but when time is not at a premium, it merits a low priority as a criterion for 
choosing a nonparametric test. Indeed, most statistical software packages now 
include a wide variety of nonparametric analysis options, making considerations 
about computation speed unnecessary. 


4. Nonparametric procedures may be applied when the data being analyzed consist 
merely of rankings or classifications. That is, the data may not be based on a 


672 


CHAPTER 13 NONPARAMETRIC AND DISTRIBUTION-FREE STATISTICS 


measurement scale strong enough to allow the arithmetic operations necessary for 
carrying out parametric procedures. The subject of measurement scales is discussed 
in more detail in the next section. 


Although nonparametric statistics enjoy a number of advantages, their disadvantages 
must also be recognized. 


1. The use of nonparametric procedures with data that can be handled with a parametric 
procedure results in a waste of data. 


2. The application of some of the nonparametric tests may be laborious for large 
samples. 


13.2 MEASUREMENT SCALES 


As was pointed out in the previous section, one of the advantages of nonparametric sta- 
tistical procedures is that they can be used with data that are based on a weak measurement 
scale. To understand fully the meaning of this statement, it is necessary to know and 
understand the meaning of measurement and the various measurement scales most 
frequently used. At this point the reader may wish to refer to the discussion of measurement 
scales in Chapter 1. 

Many authorities are of the opinion that different statistical tests require different 
measurement scales. Although this idea appears to be followed in practice, there are 
alternative points of view. 

Data based on ranks, as will be discussed in this chapter, are commonly encountered 
in statistics. We may, for example, simply note the order in which a sample of subjects 
complete an event instead of the actual time taken to complete it. More often, however, we 
use a rank transformation on the data by replacing, prior to analysis, the original data by 
their ranks. Although we usually lose some information by employing this procedure (for 
example, the ability to calculate the mean and variance), the transformed measurement 
scale allows the computation of most nonparametric statistical procedures. In fact, most of 
the commonly used nonparametric procedures, including most of those presented in this 
chapter, can be obtained by first applying the rank transformation and then using the 
standard parametric procedure on the transformed data instead of on the original data. For 
example, if we wish to determine whether two independent samples differ, we may employ 
the independent samples f test if the data are approximately normally distributed. If we 
cannot make the assumption of normal distributions, we may, as we shall see in the sections 
that follow, employ an appropriate nonparametric test. In lieu of these procedures, we could 
first apply the rank transformation on the data and then use the independent samples f test 
on the ranks. This will provide an equivalent test to the nonparametric test, and is a useful 
tool to employ if a desired nonparametric test is not available in your available statistical 
software package. 

Readers should also keep in mind that other transformations (e.g., taking the 
logarithm of the original data) may sufficiently normalize the data such that standard 
parametric procedures can be used on the transformed data in lieu of using nonparametric 
methods. 
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The familiar £ test is not strictly valid for testing (1) the null hypothesis that a population 
mean is equal to some particular value, or (2) the null hypothesis that the mean of a 
population of differences between pairs of measurements is equal to zero unless the relevant 
populations are at least approximately normally distributed. Case 2 will be recognized as a 
situation that was analyzed by the paired comparisons test in Chapter 7. When the normality 
assumptions cannot be made or when the data at hand are ranks rather than measurements 
on an interval or ratio scale, the investigator may wish for an optional procedure. Although 
the г test is known to be rather insensitive to violations of the normality assumption, there 
are times when an alternative test is desirable. 

A frequently used nonparametric test that does not depend on the assumptions of the £ 
test is the sign test. This test focuses on the median rather than the mean as a measure of 
central tendency or location. The median and mean will be equal in symmetric distribu- 
tions. The only assumption underlying the test is that the distribution of the variable of 
interest is continuous. This assumption rules out the use of nominal data. 

The sign test gets its name from the fact that pluses and minuses, rather than 
numerical values, provide the raw data used in the calculations. We illustrate the use of the 
sign test, first in the case of a single sample, and then by an example involving paired 
samples. 


EXAMPLE 13.3.1 


Researchers wished to know if instruction in personal care and grooming would improve the 
appearance of mentally retarded girls. In a school for the mentally retarded, 10 girls selected 
at random received special instruction in personal care and grooming. Two weeks after 
completion of the course of instruction the girls were interviewed by a nurse and a social 
worker who assigned each girl a score based on her general appearance. The investigators 
believed that the scores achieved the level of an ordinal scale. They felt that although a score 
of, say, 8 represented a better appearance than a score of 6, they were unwilling to say that the 
difference between scores of 6 and 8 was equal to the difference between, say, scores of 8 and 
10; or that the difference between scores of 6 and 8 represented twice as much improvement 
as the difference between scores of 5 and 6. The scores are shown in Table 13.3.1. We wish to 
know if we can conclude that the median score of the population from which we assume this 
sample to have been drawn is different from 5. 


TABLE 13.3.1 General Appearance 
Scores of 10 Mentally Retarded Girls 


Girl Score Girl Score 
1 4 6 6 
2 5 7 10 
3 8 8 7 
4 8 9 6 
5 9 10 6 
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Solution: 


Na 


Data. See problem statement. 
Assumptions. We assume that the measurements are taken on a 
continuous variable. 


Hypotheses. 


Но : The population median 15 5. 
На : The population median is not 5. 


Let a = .05. 


Test statistic. The test statistic for the sign test is either the observed 
number of plus signs or the observed number of minus signs. The nature 
of the alternative hypothesis determines which of these test statistics 
is appropriate. In a given test, any one of the following alternative 
hypotheses is possible: 


Ha4:P(-)»(-) one-sided alternative 
Hy: P(+) <(—) one-sided alternative 
НА : P(+) 5 1(—) two-sided alternative 


If the alternative hypothesis is 
НА: P(+) > Р(-) 


a sufficiently small number of minus signs causes rejection of Но. The 
test statistic is the number of minus signs. Similarly, if the alternative 
hypothesis is 


Ha: P(+) < Р(-) 


a sufficiently small number of plus signs causes rejection of Ho. The test 
statistic is the number of plus signs. If the alternative hypothesis is 


НА : P(+) A P(—) 


either a sufficiently small number of plus signs or a sufficiently small 
number of minus signs causes rejection of the null hypothesis. We may 
take as the test statistic the less frequently occurring sign. 


Distribution of test statistic. As a first step in determining the nature of 
the test statistic, let us examine the data in Table 13.3.1 to determine 
which scores lie above and which ones lie below the hypothesized 
median of 5. If we assign a plus sign to those scores that lie above the 
hypothesized median and a minus to those that fall below, we have the 
results shown in Table 13.3.2. 


If the null hypothesis were true, that is, if the median were, in fact, 
5, we would expect the numbers of scores falling above and below 5 to be 
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TABLE 13.3.2 Scores Above (+) and Below (—) the Hypothesized Median Based 
on Data of Example 13.3.1 


Girl 1 2 3 4 5 6 7 8 9 10 


Score relative to - 0 + + + + + 2 g Еа 
hypothesized 
median 


approximately equal. This line of reasoning suggests an alternative way in 
which we could have stated the null hypothesis, namely, that the prob- 
ability of a plus is equal to the probability of a minus, and these 
probabilities are equal to .5. Stated symbolically, the hypothesis would be 


Но: P(+) = P(-) 5.5 


In other words, we would expect about the same number of plus signs as 
minus signs in Table 13.3.2 when Но is true. A look at Table 13.3.2 reveals 
a preponderance of pluses; specifically, we observe eight pluses, one 
minus, and one zero, which was assigned to the score that fell exactly on 
the median. The usual procedure for handling zeros is to eliminate them 
from the analysis and reduce n, the sample size, accordingly. If we follow 
this procedure, our problem reduces to one consisting of nine observa- 
tions of which eight are plus and one is minus. 

Since the number of pluses and minuses is not the same, we 
wonder if the distribution of signs is sufficiently disproportionate to cast 
doubt on our hypothesis. Stated another way, we wonder if this small a 
number of minuses could have come about by chance alone when the 
null hypothesis is true, or if the number is so small that something other 
than chance (that is, a false null hypothesis) is responsible for the 
results. 

Based on what we learned in Chapter 4, it seems reasonable to 
conclude that the observations in Table 13.3.2 constitute a set of n 
independent random variables from the Bernoulli population with param- 
eter p. If we let k — the test statistic, the sampling distribution of k is the 
binomial probability distribution with parameter p — .5 if the null 
hypothesis is true. 


6. Decision rule. The decision rule depends on the alternative hypothesis. 

For Ha : P(+) > P(—), reject Но if, when Но is true, the probability of 
observing k or fewer minus signs is less than or equal to o. 

For H4 : P(4-) « P(—), reject Ho if the probability of observing, when 
Но is true, К or fewer plus signs is equal to or less than o. 

For Ha: P(+) 4 P(—), reject Но if (given that Но is true) the 
probability of obtaining a value of k as extreme as or more extreme 
than was actually computed is equal to or less than a/2. 


For this example the decision rule is: Reject Но if the p value for the 
computed test statistic is less than or equal to .05. 
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7. Calculation of test statistic. We may determine the probability of 
observing x or fewer minus signs when given a sample of size n and 
parameter p by evaluating the following expression: 


x 


P(k € x|n,p) = M, Cw q"* (13.3.1) 
k=0 


For our example we would compute 


9Co(-5)°(.5)? + ,C,(.5)! (.5)?-! = .00195 + .01758 = .0195 


8. Statistical decision. In Appendix Table B we find 
P(k < 1|9,.5) = .0195 


With a two-sided test either a sufficiently small number of minuses 
orasufficiently small number of pluses would cause rejection of the null 
hypothesis. Since, in our example, there are fewer minuses, we focus our 
attention on minuses rather than pluses. By setting o equal to .05, we are 
saying that if the number of minuses is so small that the probability of 
observing this few or fewer is less than .025 (half of œ), we will reject the 
null hypothesis. The probability we have computed, .0195, is less than 
.025. We, therefore, reject the null hypothesis. 


9. Conclusion. We conclude that the median score is not 5. 
10. p value. The p value for this test is 2(.0195) — .0390. ш 


Sign Test: Paired Data When the data to be analyzed consist of observations in 
matched pairs and the assumptions underlying the £ test are not met, or the measurement 
scale is weak, the sign test may be employed to test the null hypothesis that the median 
difference is O. An alternative way of stating the null hypothesis is 


P(X; > Yi) = Р(Х; < Yi) 2.5 


One of the matched scores, say, Y;, is subtracted from the other score, X;. If Y; is less 
than X;, the sign of the difference is +, and if Y; is greater than X;, the sign of the difference 
is —. If the median difference is 0, we would expect a pair picked at random to be just as 
likely to yield a -- as a — when the subtraction is performed. We may state the null 
hypothesis, then, as 


Ho : Р(+) = Р(—) = 5 


In a random sample of matched pairs, we would expect the number of 4-'s and —'s to be 
about equal. If there are more +’s or more —’s than can be accounted for by chance alone 
when the null hypothesis is true, we will entertain some doubt about the truth of our null 
hypothesis. By means of the sign test, we can decide how many of one sign constitutes 
more than can be accounted for by chance alone. 
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EXAMPLE 13.3.2 


A dental research team wished to know if teaching people how to brush their teeth would 
be beneficial. Twelve pairs of patients seen in a dental clinic were obtained by carefully 
matching on such factors as age, sex, intelligence, and initial oral hygiene scores. One 
member of each pair received instruction on how to brush his or her teeth and on other 
oral hygiene matters. Six months later all 24 subjects were examined and assigned an 
oral hygiene score by a dental hygienist unaware of which subjects had received the 
instruction. A low score indicates a high level of oral hygiene. The results are shown in 
Table 13.3.3. 


Solution: 


1. Data. See problem statement. 


2. Assumptions. We assume that the population of differences between 
pairs of scores is a continuous variable. 


3. Hypotheses. If the instruction produces a beneficial effect, this fact 
would be reflected in the scores assigned to the members of each pair. If 
we take the differences X; — Y;, we would expect to observe more —'s 
than 4-'s if instruction had been beneficial, since a low score indicates а 
higher level of oral hygiene. If, in fact, instruction is beneficial, the 
median of the hypothetical population of all such differences would be 
less than 0, that is, negative. If, on the other hand, instruction has по 
effect, the median of this population would be zero. The null and 
alternate hypotheses, then, are: 


TABLE 13.3.3 Oral Hygiene Scores of 12 
Subjects Receiving Oral Hygiene Instruction (X;) 
and 12 Subjects Not Receiving Instruction (Y;) 


Score 

Pair Number Instructed (X) Not Instructed (Y) 
1 1.5 2.0 
2 2.0 2.0 
3 3.5 4.0 
4 3.0 2.5 
5 3.5 4.0 
6 2.5 3.0 
7 2.0 3.5 
8 1.5 3.0 
9 1.5 2.5 
10 2.0 2.5 
11 3.0 2.5 


12 2.0 2.5 
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TABLE 13.3.4 Signs of Differences (X; — Y;) in Oral Hygiene Scores of 12 
Subjects Instructed (X;) and 12 Matched Subjects Not Instructed (Y;) 


Pair 


1 2 3 4 5 6 7 8 9 10 11 12 


Sign of score 
differences 


e^ UH ues uM це "om 


Но: The median of the differences is zero [P(4-) = P(—)]. 
Ha: The median of the differences is negative [P(4-) « P(—)]. 


Let о be .05. 


4. Test statistic. The test statistic is the number of plus signs. 


10. 


Distribution of test statistic. The sampling distribution of k is the 
binomial distribution with parameters n and .5 if Ho is true. 


Decision rule. Reject Ho if P(k € 2|11,.5) < .05. 


. Calculation of test statistic. As will be seen, the procedure here is 


identical to the single sample procedure once the score differences have 
been obtained for each pair. Performing the subtractions and observing 
signs yields the results shown in Table 13.3.4. 

The nature of the hypothesis indicates a one-sided test so that all of 
a = .05 is associated with the rejection region, which consists of all values 
of k (where kis equal to the number of + signs) for which the probability of 
obtaining that many or fewer pluses due to chance alone when Но is true is 
equal to or less than .05. We see in Table 13.3.4 that the experiment yielded 
one zero, two pluses, and nine minuses. When we eliminate the zero, the 
effective sample size 15 п = 11 with two pluses and nine minuses. In other 
words, since a “small” number of plus signs will cause rejection of the null 
hypothesis, the value of our test statistic is k = 2. 
Statistical decision. We want to know the probability of obtaining no 
more than two pluses out of 11 tries when the null hypothesis is true. As 
we have seen, the answer is obtained by evaluating the appropriate 
binomial expression. In this example we find 

2 


P(k < 2.|11,.5) = X qeQC 69) ^ 
k=0 


By consulting Appendix Table B, we find this probability to be .0327. 
Since .0327 is less than .05, we must reject Ho. 


Conclusion. We conclude that the median difference is negative. That 
18, we conclude that the instruction was beneficial. 


p value. For this test, p — .0327. a 


Sign Test with "Greater Than” Tables As has been demonstrated, the 
sign test may be used with a single sample or with two samples in which each member of 
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one sample is matched with a member of the other sample to form a sample of matched 
pairs. We have also seen that the alternative hypothesis may lead to either a one-sided or a 
two-sided test. In either case we concentrate on the less frequently occurring sign and 
calculate the probability of obtaining that few or fewer of that sign. 

We use the least frequently occurring sign as our test statistic because the binomial 
probabilities in Appendix Table B are “less than or equal to" probabilities. By using the least 
frequently occurring sign, we can obtain the probability we need directly from Table B 
without having to do any subtracting. If the probabilities in Table B were "greater than or 
equal to" probabilities, which are often found in tables of the binomial distribution, we would 
use the more frequently occurring sign as our test statistic in order to take advantage of the 
convenience of obtaining the desired probability directly from the table without having to do 
any subtracting. In fact, we could, in our present examples, use the more frequently occurring 
sign as our test statistic, but because Table B contains “less than or equal to" probabilities we 
would have to perform a subtraction operation to obtain the desired probability. As an 
illustration, consider the last example. If we use as our test statistic the most frequently 
occurring sign, itis 9, the number of minuses. The desired probability, then, is the probability 
of nine or more minuses, when n — 11 and p — .5. That is, we want 


P(k = 9|11,.5) 


However, since Table B contains “less than or equal to" probabilities, we must obtain this 
probability by subtraction. That is, 


P(k29|11,.5) = 1 — P(k € 8|11, .5) 
1 — .9673 
= 0327 


which is the result obtained previously. 


Sample Size We saw in Chapter 5 that when the sample size is large and when p is 
close to .5, the binomial distribution may be approximated by the normal distribution. The 
rule of thumb used was that the normal approximation is appropriate when both np and nq 
are greater than 5. When p — .5, as was hypothesized in our two examples, a sample of size 
12 would satisfy the rule of thumb. Following this guideline, one could use the normal 
approximation when the sign test is used to test the null hypothesis that the median or 
median difference is O and n is equal to or greater than 12. Since the procedure involves 
approximating a continuous distribution by a discrete distribution, the continuity correc- 
tion of .5 is generally used. The test statistic then is 


(k+.5) — п 


Е 78 (13.3.2) 


< = 


which is compared with the value of z from the standard normal distribution corresponding 
to the chosen level of significance. In Equation 13.3.2, k + .5 is used when k < п/2 and 
k — .5 is used when К > n/2. 
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896 10 7 6 6 
Dialog box: Session command: 


Stat » Nonparametrics » 1-Sample Sign MTB > STest 5 Cl; 
SUBC> Alternative 


Type СІ in Variables. Choose Test median and type 5 in 


the text box. Click OK. 
Output: 


Sign Test for Median: C1 


Sign test of median = 5.00 versus N.E. 5.000 
N BELOW EQUAL ABOVE P-VALUE MEDIAN 
C1 10 1 1 8 0.0391 6.500 


FIGURE 13.3.1 MINITAB procedure and output for Example 13.3.1. 


Computer Analysis Many statistics software packages will perform the sign test. 
For example, if we use MINITAB to perform the test for Example 13.3.1 in which the data 
are stored in Column 1, the procedure and output would be as shown in Figure 13.3.1. 


EXERCISES 


13.3.1 А random sample of 15 student nurses was given a test to measure their level of authoritarianism with 
the following results: 


Student Authoritarianism Student Authoritarianism 
Number Score Number Score 

1 75 9 82 

2. 90 10 104 

3 85 11 88 

4 110 12 124 

5 115 13 110 

6 95 14 76 

7 132 15 98 

8 74 


Test at the .05 level of significance, the null hypothesis that the median score for the sampled 
population is 100. Determine the p value. 
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13.3.2 Determining the effects of grapefruit juice on pharmacokinetics of oral digoxin (a drug often 
prescribed for heart ailments) was the goal of a study by Parker et al. (A-1). Seven healthy 
nonsmoking volunteers participated in the study. Subjects took digoxin with water for 2 weeks, 
no digoxin for 2 weeks, and digoxin with grapefruit juice for 2 weeks. The average peak plasma 
digoxin concentration (Cmax) when subjects took digoxin with water is given in the first column of 
the following table. The second column gives the Cmax concentration when subjects took digoxin 
with grapefruit juice. May we conclude on the basis of these data that the Cmax concentration is 
higher when digoxin is taken with grapefruit juice? Let o — .5. 


Cmax 
Subject H,O GFJ 
1 2.34 3.03 
2 2.46 3.46 
3 1.87 1.97 
4 3.09 3.81 
5 5.59 3.07 
6 4.05 DOD? NOT TM 
7 6.21 3.44 ource: Data provided courtesy o 


Robert B. Parker, Pharm.D. 


13.3.3 А sample of 15 patients suffering from asthma participated in an experiment to study the effect of a 
new treatment on pulmonary function. Among the various measurements recorded were those of 
forced expiratory volume (liters) in 1 second (FEV) before and after application of the treatment. 
The results were as follows: 


Subject Before After Subject Before After 
1 1.69 1.69 9 2.58 2.44 
2 2.77 2:22 10 1.84 4.17 
3 1.00 3.07 11 1.89 2.42 
4 1.66 3.35 12 1.91 2.94 
5 3.00 3.00 13 1.75 3.04 
6 .85 2.74 14 2.46 4.62 
7 1.42 3.61 15 2.35 4.42 
8 2.82 5.14 


On the basis of these data, can one conclude that the treatment is effective in increasing the FEV, 
level? Let о = .05 and find the p value. 


13.4 THEWILCOXON SIGNED-RANK 
TEST FOR LOCATION 


Sometimes we wish to test a null hypothesis about a population mean, but for some reason 
neither z nor f is an appropriate test statistic. If we have a small sample (n « 30) from a 
population that is known to be grossly nonnormally distributed, and the central limit 
theorem is not applicable, the z statistic is ruled out. The 1 statistic is not appropriate 
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because the sampled population does not sufficiently approximate a normal distribution. 
When confronted with such a situation we usually look for an appropriate nonparametric 
statistical procedure. As we have seen, the sign test may be used when our data consist of a 
single sample or when we have paired data. If, however, the data for analysis are measured 
on at least an interval scale, the sign test may be undesirable because it would not make full 
use of the information contained in the data. A more appropriate procedure might be the 
Wilcoxon (1) signed-rank test, which makes use of the magnitudes of the differences 
between measurements and a hypothesized location parameter rather than just the signs of 
the differences. 


Assumptions The Wilcoxon test for location is based on the following assumptions 
about the data. 

1. The sample is random. 

2. The variable is continuous. 

3. The population is symmetrically distributed about its mean и. 

4. 


The measurement scale is at least interval. 


Hypotheses The following are the null hypotheses (along with their alternatives) 
that may be tested about some unknown population mean uy. 


(a) Но: и = що (b) Ho: u > мо (c) Ho: & < Mo 
Ha: f Mo НА: И < ш Ha : u > мо 


When we use the Wilcoxon procedure, we perform the following calculations. 


1. Subtract the hypothesized mean шо from each observation x;, to obtain 
d; = Xi — Шо 


If any x; is equal to the mean, so that d; = 0, eliminate that d; from the calculations 
and reduce n accordingly. 


2. Rank the usable d; from the smallest to the largest without regard to the sign of d;. 
That is, consider only the absolute value of the d;, designated |d;|, when ranking 
them. If two or more of the |d;| are equal, assign each tied value the mean of the 
rank positions the tied values occupy. If, for example, the three smallest |d;| are all 
equal, place them in rank positions 1, 2, and 3, but assign each a rank of 
(1+2 3/3 = 2. 

3. Assign each rank the sign of the d; that yields that rank. 


4. Find T ,, the sum of the ranks with positive signs, and T_, the sum of the ranks with 
negative signs. 


The Test Statistic The Wilcoxon test statistic is either Т, or T_, depending on 
the nature of the alternative hypothesis. If the null hypothesis is true, that is, if the true 
population mean is equal to the hypothesized mean, and if the assumptions are met, the 
probability of observing a positive difference d; = x; — цо of a given magnitude is equal to 
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the probability of observing a negative difference of the same magnitude. Then, in repeated 
sampling, when the null hypothesis is true and the assumptions are met, the expected value 
of T+ is equal to the expected value of T_. We do not expect T} and T_ computed from a 
given sample to be equal. However, when Но 15 true, we do not expect a large difference in 
their values. Consequently, a sufficiently small value of Т, or a sufficiently small value 
of T_ will cause rejection of Ho. 

When the alternative hypothesis is two-sided (u Z шо), either a sufficiently small 
value of T, or a sufficiently small value of T_ will cause us to reject Ho : и = мо. The test 
statistic, then, is Т; or T_, whichever is smaller. To simplify notation, we call the smaller of 
the two T. 

When Ho: и > йо is true, we expect our sample to yield a large value of T+. 
Therefore, when the one-sided alternative hypothesis states that the true population mean is 
less than the hypothesized mean (и < шо), a sufficiently small value of T} will cause 
rejection of Ho, and T', is the test statistic. 

When Ho: и < uy is true, we expect our sample to yield a large value of T_. 
Therefore, for the one-sided alternative Ha : и > шо, a sufficiently small value of T- will 
cause rejection of H and Т_ is the test statistic. 


Critical Values Critical values of the Wilcoxon test statistic are given in 
Appendix Table K. Exact probability levels (P) are given to four decimal places for 
all possible rank totals (7) that yield a different probability level at the fourth decimal 
place from .0001 up through .5000. The rank totals (7) are tabulated for all sample sizes 
from n — 5 through n — 30. The following are the decision rules for the three possible 
alternative hypotheses: 


(a) Ha: 7 ио. Reject Но at the o level of significance if the calculated T is smaller 
than or equal to the tabulated T for п and preselected œ /2. Alternatively, we may enter 
Table К with п and our calculated value of T to see whether the tabulated P associated 
with the calculated Tis less than ог equal to our stated level of significance. If so, we 
may reject Ho. 

(b) Ha : и < цо. Reject Но at the о level of significance if T, is less than or equal to the 
tabulated T for n and preselected o. 


(c) Ha : u > цо. Reject Ho at the o level of significance if T_ is less than or equal to the 
tabulated T for n and preselected o. 


EXAMPLE 13.4.1 


Cardiac output (liters/minute) was measured by thermodilution in a simple random 
sample of 15 postcardiac surgical patients in the left lateral position. The results were as 
follows: 


4.91 4.10 6.74 7.27 742 7.50 6.56 4.64 
5.98 3.14 3.23 5.80 6.17 5.39 5.77 


We wish to know if we can conclude on the basis of these data that the population mean is 
different from 5.05. 
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Solution: 
1. Data. See statement of example. 
2. Assumptions. We assume that the requirements for the application of 
the Wilcoxon signed-ranks test are met. 
3. Hypotheses. 
Но: = 5.05 
На : и 5.05 
Let а = 0.05. 
4. Test statistic. The test statistic will be Т, or T. , whichever is smaller. 
We will call the test statistic T. 
5. Distribution of test statistic. Critical values of the test statistic are 
given in Table K of the Appendix. 
6. Decision rule. We will reject Ho if the computed value of Tis less than 
or equal to 25, the critical value for n = 15, and а /2 = .0240, the closest 
value to .0250 in Table K. 
7. Calculation of test statistic. The calculation of the test statistic is 
shown in Table 13.4.1. 
8. Statistical decision. Since 34 is greater than 25, we are unable to 
reject Ho. 
9. Conclusion. We conclude that the population mean may be 5.05. 
10. p value. From Table K we see that p — 2(.0757) — .1514. 
TABLE 13.4.1 Calculation of the Test Statistic for Example 13.4.1 
Cardiac 
Output d; — x; — 5.05 Rank of |d;| Signed Rank of |d;| 
4.91 —.14 1 -1 
4.10 -.95 7 -7 
6.74 +1.69 10 +10 
7.27 +2.22 13 +13 
7.42 +2.37 14 +14 
7.50 +2.45 15 +15 
6.56 +1.51 9 +9 
4.64 —.41 3 -3 
5.98 4.93 6 +6 
3.14 —1.91 12 —12 
3.23 —1.82 11 —11 
5.80 4.75 5 +5 
6.17 +1.12 8 +8 
5.39 +.34 2 +2 
5.77 +.72 4 +4 


T, = 86, Т_ = 34, T = 34 
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Dialog box: Session command: 


Stat » Nonparametrics » 1-Sample Wilcoxon MTB » WTEST 5.05 C1; 


SUBC» Alternative 0. 


Type СІ in Variables. Choose Test median. Type 5.05 іп 
the text box. Click OK. 


Output: 


Wilcoxon Signed Rank Test: C1 


TEST OF 


MI 


EDIAN = 5.050 VERSUS MEDIAN N.E. 


N FOR WILCOXON 
EST STATISTIC P-VALUE 
15 86.0 0.148 


FIGURE 13.4.1 МІМІТАВ procedure and output for Example 13.4.1. 


Wilcoxon Matched-Pairs Signed-Ranks Test The Wilcoxon test may 
be used with paired data under circumstances in which it is not appropriate to use 
the paired-comparisons ¢ test described in Chapter 7. In such cases obtain each of the 
n d; values, the difference between each of the n pairs of measurements. If we let 
[Lp = the mean of a population of such differences, we may follow the procedure 
described above to test any one of the following null hypotheses: Ho: up = 0, 
Ho: up > 0, and Ho: up < 0. 


Computer Analysis Many statistics software packages will perform the Wil- 
coxon signed-rank test. If, for example, the data of Example 13.4.1 are stored in Column 1, 
we could use MINITAB to perform the test as shown in Figure 13.4.1. 


EXERCISES 


13.4.1 Sixteen laboratory animals were fed a special diet from birth through age 12 weeks. Their weight 


13.4.2 


gains (in grams) were as follows: 
63 6 79 65 64 63 65 64 76 74 66 66 67 73 69 76 


Can we conclude from these data that the diet results in a mean weight gain of less than 70 grams? Let 
a = .05, and find the p value. 


Amateur and professional singers were the subjects of a study by Grape et al. (A-2). The researchers 
investigated the possible beneficial effects of singing on well-being during a single singing lesson. 
One of the variables of interest was the change in cortisol as a result of the signing lesson. Use the data 
in the following table to determine if, in general, cortisol (nmol/L) increases after a singing lesson. 
Let a = .05. Find the р value. 
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13.4.3 


Subject 1 2 3 4 5 6 7 8 
Before 214 362 202 158 403 219 307 331 
After 232 276 224 412 562 203 340 313 


Source: Data provided courtesy of Christina Grape, M.P.H., Licensed Nurse. 


In a study by Zuckerman and Heneghan (A-3), hemodynamic stresses were measured on subjects 
undergoing laparoscopic cholecystectomy. An outcome variable of interest was the ventricular end 
diastolic volume (LVEDV) measured in milliliters. A portion of the data appear in the following table. 
Baseline refers to a measurement taken 5 minutes after induction of anesthesia, and the term “5 
minutes" refers to a measurement taken 5 minutes after baseline. 


LVEDV (ml) 

Subject Baseline 5 Minutes 

1 51.7 49.3 

2 79.0 72.0 

3 78.7 87.3 

4 80.3 88.3 

5 72.0 103.3 

6 85.0 94.0 

7 69.7 94.7 

8 71.3 46.3 

2 d 7 Source: Data provided courtesy 
10 56.3 72.3 к 


of В. S. Zuckerman, MD. 


May we conclude, on the basis of these data, that among subjects undergoing laparoscopic 
cholecystectomy, the average LVEDV levels change? Let o — .01. 


13.5 THE MEDIAN TEST 


A nonparametric procedure that may be used to test the null hypothesis that two 
independent samples have been drawn from populations with equal medians is the median 
test. The test, attributed mainly to Mood (2) and Westenberg (3), is also discussed by Brown 
and Mood (4). 

We illustrate the procedure by means of an example. 


EXAMPLE 13.5.1 

Do urban and rural male junior high school students differ with respect to their level of 
mental health? 

Solution: 


1. Data. Members of a random sample of 12 male students from a rural 
junior high school and an independent random sample of 16 male 


TABLE 13.5.1 
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Level of Mental Health Scores of 


Junior High Boys 


School 

Urban Rural Urban Rural 
35 29 25 50 
26 50 27 37 
27 43 45 34 
21 22 46 31 
27 42 33 

38 47 26 

23 42 46 

25 32 41 


2. 


students from an urban junior high school were given a test to measure 
their level of mental health. The results are shown in Table 13.5.1. 
To determine if we can conclude that there is a difference, we 
perform a hypothesis test that makes use of the median test. Suppose we 
choose a .05 level of significance. 


Assumptions. The assumptions underlying the test are (a) the samples 
are selected independently and at random from their respective popula- 
tions; (b) the populations are of the same form, differing only in 
location; and (c) the variable of interest is continuous. The level of 
measurement must be, at least, ordinal. The two samples do not have to 
be of equal size. 


Hypotheses. 
Ho : My = Mp 
HA : My A Mr 


My is the median score of the sampled population of urban students, 
and Mg is the median score of the sampled population of rural students. 
Let а = .05. 


Test statistic. As will be shown in the discussion that follows, the test 
statistic is X? as computed, for example, by Equation 12.4.1 for a 2 x 2 
contingency table. 

Distribution of test statistic. When Но is true and the assumptions 
are met, X? is distributed approximately as x? with 1 degree of freedom. 
Decision rule. Reject Но if the computed value of X? is > 3.841 (since 
о = .05). 

Calculation of test statistic. The first step in calculating the test statistic 


is to compute the common median of the two samples combined. This is 
done Бу arranging the observations in ascending order 
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TABLE 13.5.2 Level of Mental Health Scores of 
Junior High School Boys 


Urban Rural Total 
Number of scores above median 6 8 14 
Number of scores below median 10 4 14 


Total 16 12 28 


and, because the total number of observations is even, obtaining the 
mean of the two middle numbers. For our example the median is 
(33 + 34) /2 = 33.5. 

We now determine for each group the number of observations 
falling above and below the common median. The resulting frequencies 
are arranged in a 2 x 2 table. For the present example we construct 
Table 13.5.2. 

If the two samples are, in fact, from populations with the same 
median, we would expect about one-half the scores in each sample to be 
above the combined median and about one-half to be below. If the 
conditions relative to sample size and expected frequencies for a 2 x 
2 contingency table as discussed in Chapter 12 are met, the chi-square test 
with 1 degree of freedom may be used to test the null hypothesis of equal 
population medians. For our examples we have, by Formula 12.4.1, 


28[(6)(4) — (8) (10)? 


х = (16)(12)(14)(14) 


= 2.33 


8. Statistical decision. Since 2.33 < 3.841, the critical value of x? with 
о = .05 and 1 degree of freedom, we are unable to reject the null 
hypothesis on the basis of these data. 


9. Conclusion. We conclude that the two samples may have been drawn 
from populations with equal medians. 


10. p value. Since 2.33 < 2.706, we have p > .10. и 


Handling Values Equal to the Median Sometimes one ог more observed 
values will be exactly equal to the common median and, hence, will fall neither above nor 
below it. We note that if nı + m is odd, at least one value will always be exactly equal to the 
median. This raises the question of what to do with observations of this kind. One solution 
is to drop them from the analysis if п; + m is large and there are only a few values that fall 
at the combined median. Or we may dichotomize the scores into those that exceed the 
median and those that do not, in which case the observations that equal the median will be 
counted in the second category. 


Median Test Extension The median test extends logically to the case where it is 
desired to test the null hypothesis that k > 3 samples are from populations with equal 
medians. For this test a 2 x К contingency table may be constructed by using the 
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Dialog box: Session command: 


Stat » Nonparametrics » Mood's Median Test MTB » Mood C1 C2. 


Type СІ in Response and C2 in Factor. Click OK. 


Output: 
Mood Median Test: C1 versus C2 
Mood median test of C1 
Chisquare = 2.33 df 
Individual 95.0$ CIs 
C2 N<= М» Median 


1 10 6 27.0 
2 4 8 39.5 


Overall median = 


A 95.0% C.I. for median (1) - median(2): 


FIGURE 13.5.1 MINITAB procedure and output for Example 13.5.1. 


frequencies that fall above and below the median computed from combined samples. If 
conditions as to sample size and expected frequencies are met, X may be computed and 
compared with the critical x? with k — 1 degrees of freedom. 


Computer Analysis The median test calculations may be carried out using 
MINITAB. To illustrate using the data of Example 13.5.1 we first store the measurements 
in MINITAB Column 1. In MINITAB Column 2 we store codes that identify the 
Observations as to whether they are for an urban (1) or rural (2) subject. The MINITAB 
procedure and output are shown in Figure 13.5.1. 


EXERCISES 


13.5.1 Fifteen patient records from each of two hospitals were reviewed and assigned a score designed to 
measure level of care. The scores were as follows: 


Hospital A: 99, 85, 73, 98, 83, 88, 99, 80, 74, 91, 80, 94, 94, 98, 80 
Hospital B: 78, 74, 69, 79, 57, 78, 79, 68, 59, 91, 89, 55, 60, 55, 79 
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13.5.2 


Would you conclude, at the .05 level of significance, that the two population medians are different? 
Determine the p value. 


The following serum albumin values were obtained from 17 normal and 13 hospitalized subjects: 


Serum Albumin (g/100 ml) Serum Albumin (g/100 ml) 


Normal Subjects Hospitalized Subjects Normal Subjects Hospitalized Subjects 


24 3.0 15 31 34 40 3.8 15 
33-5332 20 13 4.5 3.5 3.5 

31 35 34 1.5 5.0 3.6 

4.0 3.8 17 18 2.9 

42 3.9 20 20 


Would you conclude at the .05 level of significance that the medians of the two populations sampled 
are different? Determine the p value. 


13.6 THEMANN-WHITNEY TEST 


The median test discussed in the preceding section does not make full use of all the 
information present in the two samples when the variable of interest is measured on at least an 
ordinal scale. Reducing an observation's information content to merely that of whether or not 
it falls above or below the common median is a waste of information. If, for testing the desired 
hypothesis, there is available a procedure that makes use of more of the information inherent 
in the data, that procedure should be used if possible. Such a nonparametric procedure that 
can often be used instead of the median test is the Mann-Whitney test (5), sometimes called 
the Mann-Whitney-Wilcoxon test. Since this test is based on the ranks of the observations, it 
utilizes more information than does the median test. 


Assumptions The assumptions underlying the Mann-Whitney test are as follows: 


1. The two samples, of size n and m, respectively, available for analysis have been 
independently and randomly drawn from their respective populations. 


2. The measurement scale is at least ordinal. 
3. The variable of interest is continuous. 


4. If the populations differ at all, they differ only with respect to their medians. 


Hypotheses When these assumptions are met we may test the null hypothesis that 
the two populations have equal medians against either of the three possible alternatives: (1) 
the populations do not have equal medians (two-sided test), (2) the median of population 1 
is larger than the median of population 2 (one-sided test), or (3) the median of population 1 
is smaller than the median of population 2 (one-sided test). If the two populations are 
symmetric, so that within each population the mean and median are the same, the 
conclusions we reach regarding the two population medians will also apply to the two 
population means. The following example illustrates the use of the Mann-Whitney test. 
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EXAMPLE 13.6.1 


A researcher designed an experiment to assess the effects of prolonged inhalation of 
cadmium oxide. Fifteen laboratory animals served as experimental subjects, while 10 
similar animals served as controls. The variable of interest was hemoglobin level following 
the experiment. The results are shown in Table 13.6.1. We wish to know if we can conclude 
that prolonged inhalation of cadmium oxide reduces hemoglobin level. 


Solution: 


1. Data. See Table 13.6.1. 


2. Assumptions. We assume that the assumptions of the Mann-Whitney 
test are met. 


3. Hypotheses. The null and alternative hypotheses are as follows: 


Но: Мх > My 
НА : Мх < My 


where Mx is the median of a population of animals exposed to cadmium 
oxide and M yis the median of a population of animals not exposed to the 
substance. Suppose we let о = .05. 


4. Test statistic. To compute the test statistic we combine the two samples 
and rank all observations from smallest to largest while keeping track of 
the sample to which each observation belongs. Tied observations are 
assigned a rank equal to the mean of the rank positions for which they 
are tied. The results of this step are shown in Table 13.6.2. 


TABLE 13.6.1 Hemoglobin Determinations 
(grams) for 25 Laboratory Animals 


Exposed Animals (X) Unexposed Animals (У) 
14.4 17.4 
14.2 16.2 
13.8 17.1 
16.5 17.5 
14.1 15.0 
16.6 16.0 
15.9 16.9 
15.6 15.0 
14.1 16.3 
15.3 16.8 
15.7 

16.7 

13.7 

15.3 


14.0 
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TABLE 13.6.2 Original Data and Ranks, 
Example 13.6.1 


X Rank Y Rank 

13.7 1 

13.8 2 

14.0 3 

14.1 4.5 

14.1 4.5 

14.2 6 

14.4 7 
15.0 8.5 
15.0 8.5 

15.3 10.5 

15.3 10.5 

15.6 12 

15.7 13 

15.9 14 
16.0 15 
16.2 16 
16.3 17 

16.5 18 

16.6 19 

16.7 20 
16.8 21 
16.9 22 
17.1 23 
17.4 24 
17.5 25 

Total 145 


The test statistic is 
(13.6.1) 


where п is the number of sample X observations and 5 is the sum of the 
ranks assigned to the sample observations from the population of X 
values. The choice of which sample's values we label X is arbitrary. 


5. Distribution of test statistic. Critical values from the distribution of the 
test statistic are given in Appendix Table L for various levels of «œ. 


6. Decision rule. If the median of the X population is, in fact, smaller than 
the median of the Y population, as specified in the alternative hypothesis, 
we would expect (for equal sample sizes) the sum of the ranks assigned 


13.6 THE MANN-WHITNEY TEST 693 


to the observations from the X population to be smaller than the sum of 
the ranks assigned to the observations from the Y population. The test 
statistic is based on this rationale in such a way that a sufficiently small 
value of T will cause rejection of Ho : Mx > My. In general, for one- 
sided tests of the type illustrated here the decision rule is: 


Reject Ho : Mx = My if the computed T is less than Wy, where wa is 
the critical value of Tobtained by entering Appendix Table L with n, the 
number of X observations; m, the number of Y observations; and a, the 
chosen level of significance. 


If we use the Mann-Whitney procedure to test 
H 0: M. X < M Y 


against 
НА : Мх > My 


sufficiently large values of Т will cause rejection so that the decision 
rule is: 


Reject Ho : Mx < My if computed T is greater than ма, where 
Ма = nm — Wy. 


For the two-sided test situation with 


Но: Мх = My 
НА : Mx Z My 


computed values of T that are either sufficiently large or sufficiently 
small will cause rejection of Ho. The decision rule for this case, then, is: 


Reject Ho : Mx = My if the computed value of T is either less than wa /2 
or greater than w,. (a/2) where wap is the critical value of T for n, m, and 
а/2 given in Appendix Table І, and w¡_(a/2) = nm — way». 


For this example the decision rule is: 


Reject Но if the computed value of T is smaller than 45, the critical value 
of the test statistic for n — 15, m — 10, and a — .05 found in Table L. 


The rejection regions for each set of hypotheses are shown in 
Figure 13.6.1. 


. Calculation of test statistic. For our present example we have, as 
shown in Table 13.6.2, S — 145, so that 


15(15 4- 1) 


T = 145- 
2 


= 25 
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Шт -а 


Но: Му =Му 
л: My +My 


Wal2 UA — (a/2) 


FIGURE 13.6.1 Mann-Whitney test rejection regions for three sets of hypotheses. 


8. Statistical decision. When we enter Table L with n — 15, m — 10, and 
a = .05, we find the critical value of w, to be 45. Since 25 < 45, we 
reject Ho. 

9. Conclusion. We conclude that Mx is smaller than My This leads to the 
conclusion that prolonged inhalation of cadmium oxide does reduce the 
hemoglobin level. 


10. p value. Since 22 < 25 < 30, we have for this test .005 > p > .001. 
и 


Large-Sample Approximation When either п or т is greater than 20 we 
cannot use Appendix Table L to obtain critical values for the Mann-Whitney test. When 
this is the case we may compute 


T — mn/2 


= 13.6.2 
v/nm(n + m + 1|)/12 


ра 


and compare the result, for significance, with critical values of the standard normal 
distribution. 


Mann-Whitney Statistic and the Wilcoxon Statistic As was noted 
at the beginning of this section, the Mann-Whitney test is sometimes referred to as the 
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Dialog box: Session command: 


Stat » Nonparametrics » Mann-Whitney MTB » Mann-Whitney 
cl EZ; 
BC > Alternative 


Type СІ in First Sample and C2 in Second Sample. 
At Alternative choose less than. 
Click OK. 


Output: 


Mann-Whitney Test and CI: C1, C2 


C1 N — 15 Median = 15.300 
C2 N — 10 Median = 16.550 
Point estimate for ЕТАТ — ETA2 is -1.300 
95.1 Percent С.Т. for ЕТА1 — ETA2 is (-2.300,-0.600) 
145.0 
Test of ЕТА1 = ETA2 vs. ЕТАТ < ETA2 is significant at 0.0030 
The test is significant at 0.0030 (adjusted for ties) 


FIGURE 13.6.2 MINITAB procedure and output for Example 13.6.1. 


Ranks 


y Mean Rank Sum of Rank 


1.000000 9.67 146.00 
2.000000 18.00 180.00 
Total 


Test Statistic” 


Mann-Whitney U 

Wilcoxon W 

Z 

Asymp. Sig. (2-tailed) 
Exact Sig. [2*(1-tailed Sig.)] 


a. Not corrected for ties 
b. Grouping Variable: y 


FIGURE 13.6.3 SPSS output for Example 13.6.1. 
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Mann-Whitney-Wilcoxon test. Indeed, many computer packages give the test value of 
both the Mann-Whitney test (U) and the Wilcoxon test (W). These two tests are 
algebraically equivalent tests, and are related by the following equality when there are 
no ties in the data: 


m(m + 2n + 1) 


U+W= 
A 2 


(13.6.3) 


Computer Analysis Many statistics software packages will perform the Mann- 
Whitney test. With the data of two samples stored in Columns 1 and 2, for example, 
MINITAB will perform a one-sided or two-sided test. The MINITAB procedure and output 
for Example 13.6.1 are shown in Figure 13.6.2. 

The SPSS output for Example 13.6.1 is shown in Figure 13.6.3. As we see 
this output provides the Mann-Whitney test, the Wilcoxon test, and large-sample z 
approximation. 


EXERCISES 


13.6.1 


13.6.2 


Cranor and Christensen (A-4) studied diabetics insured by two employers. Group 1 subjects were 
employed by the City of Asheville, North Carolina, and group 2 subjects were employed by Mission- 
St. Joseph's Health System. At the start of the study, the researchers performed the Mann-Whitney 
test to determine if a significant difference in weight existed between the two study groups. The data 
are displayed in the following table. 


Weight (Pounds) 
Group 1 Group 2 

252 215 240 185 195 220 
240 190 302 310 210 295 
205 270 312 212 190 202 
200 159 126 238 172 268 
170 204 268 184 190 220 
170 215 215 136 140 311 
320 254 183 200 280 164 
148 164 287 270 264 206 
214 288 210 200 270 170 
270 138 225 212 210 190 
265 240 258 182 192 

203 217 221 225 126 


Source: Data provided courtesy of Carole W. Carnor, Ph.D. 


May we conclude, on the basis of these data, that patients in the two groups differ significantly with 
respect to weight? Let о = .05. 


One of the purposes of a study by Liu et al. (A-5) was to determine the effects of MRZ 2/579 
(a receptor antagonist shown to provide neuroprotective activity in vivo and in vitro) on neurological 
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deficit in Sprague-Dawley rats. In the study, 10 rats were to receive MRZ 2/579 and nine rats were to 
receive regular saline. Prior to treatment, researchers studied the blood gas levels in the two groups of 
rats. The following table shows the pO; levels for the two groups. 


Saline (mmHg) MRZ 2/579 (mmHg) 
112.5 133.3 
106.3 106.4 
99.5 113.1 
98.3 117.2 
103.4 126.4 
109.4 98.1 
108.9 113.4 
107.4 116.8 
116.5 


Source: Data provided courtesy of Ludmila Belayev, M.D. 


May we conclude, on the basis of these data, that, in general, subjects on saline have, on average, 
lower pO; levels at baseline? Let а = .01. 


The purpose of a study by researchers at the Cleveland (Ohio) Clinic (A-6) was to determine if the use 
of Flomax? reduced the urinary side effects commonly experienced by patients following brachy- 
therapy (permanent radioactive seed implant) treatment for prostate cancer. The following table 
shows the American Urological Association (AUA) symptom index scores for two groups of subjects 
after 8 weeks of treatment. The higher the AUA index, the more severe the urinary obstruction and 
irritation. 


AUA Index (Flomax?) AUA Index (Placebo) 
1 5 11 1 6 12 
1 5 11 1 6 12 
2 6 11 2 6 13 
2; 6 11 2 6 14 
2. 7 12 2 6 17 
2 7 12 3 7 18 
3 7 13 3 8 19 
3 7 14 3 8 20 
3 8 16 3 9 23 
4 8 16 4 9 23 
4 8 18 4 10 
4 8 21 4 10 
4 9 31 5 11 
4 9 5 11 
4 10 5 12 


Source: Data provided courtesy of Chandana Reddy, M.S. 


May we conclude, on the basis of these data, that the median AUA index in the Flomax? group differs 
significantly from the median AUA index of the placebo group? Let o — .05. 
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13.7 THE KOLMOGOROV-SMIRNOV 
GOODNESS-OF-FIT TEST 


When one wishes to know how well the distribution of sample data conforms to some 
theoretical distribution, a test known as the Kolmogorov-Smirnov goodness-of-fit test 
provides an alternative to the chi-square goodness-of-fit test discussed in Chapter 12. The 
test gets its name from A. Kolmogorov and N. V. Smirnov, two Russian mathematicians 
who introduced two closely related tests in the 1930s. 

Kolmogorov's work (6) is concerned with the one-sample case as discussed here. 
Smirnov's work (7) deals with the case involving two samples in which interest centers on 
testing the hypothesis that the distributions of the two-parent populations are identical. The 
test for the first situation is frequently referred to as the Kolmogorov-Smirnov one-sample 
test. The test for the two-sample case, commonly referred to as the Kolmogorov-Smirnov 
two-sample test, will not be discussed here. 


The Test Statistic In using the Kolmogorov-Smirnov goodness-of-fit test, a 
comparison is made between some theoretical cumulative distribution function, F7(x), and 
a sample cumulative distribution function, Fs(x). The sample is a random sample from a 
population with unknown cumulative distribution function F(x). It will be recalled (Section 
4.2) that a cumulative distribution function gives the probability that X is equal to or less 
than a particular value, x. That is, by means of the sample cumulative distribution function, 
Fs(x), we may estimate Р(Х < x). If there is close agreement between the theoretical and 
sample cumulative distributions, the hypothesis that the sample was drawn from the 
population with the specified cumulative distribution function, Ку(х), is supported. If, 
however, there is a discrepancy between the theoretical and observed cumulative distribu- 
tion functions too great to be attributed to chance alone, when Но is true, the hypothesis 
15 rejected. 

The difference between the theoretical cumulative distribution function, F(x), and 
the sample cumulative distribution function, Fs(x), is measured by the statistic D, which is 
the greatest vertical distance between F(x) and Ет(х). When a two-sided test is appropri- 
ate, that is, when the hypotheses are 


Ho: F(x) = Ет(х) forallx from —oo to +оо 


Hy: F(x) = Ет(х) for at least one x 


the test statistic is 


D = sup |Fs(x) — Fr(x)| (13.7.1) 


which is read, “D equals the supremum (greatest), over all x, of the absolute value of the 
difference Fs(X) minus F7(X).” 

The null hypothesis is rejected at the o level of significance if the computed value 
of D exceeds the value shown in Appendix Table M for 1 — o (two-sided) and the sample 
size n. 
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Assumptions The assumptions underlying the Kolmogorov-Smirnov test include 
the following: 
1. The sample is a random sample. 
2. The hypothesized distribution F7(x) is continuous. 
When values of D are based on a discrete theoretical distribution, the test is 
conservative. When the test is used with discrete data, then, the investigator should 
bear in mind that the true probability of committing a type I error is at most equal to a, the 


stated level of significance. The test is also conservative if one or more parameters have to 
be estimated from sample data. 


EXAMPLE 13.7.1 


Fasting blood glucose determinations made on 36 nonobese, apparently healthy, adult 
males are shown in Table 13.7.1. We wish to know if we may conclude that these data are 
not from a normally distributed population with a mean of 80 and a standard deviation of 6. 


Solution: 


1. Data. See Table 13.7.1. 


2. Assumptions. The sample available is a simple random sample from a 
continuous population distribution. 


3. Hypotheses. The appropriate hypotheses are 
Но: F(x) = Fr(x) г айх from —oo to +оо 
Ha: F(x) = Ет(х) for at least опе x 


Let a — .05. 
4. Test statistic. See Equation 13.7.1. 


5. Distribution of test statistic. Critical values of the test statistic for 
selected values of o are given in Appendix Table M. 


6. Decision rule. Reject Но if the computed value of D exceeds .221, the 
critical value of D for n = 36 and а = .05. 


7. Calculation of test statistic. Our first step is to compute values of Fs(x) 
as shown in Table 13.7.2. 


TABLE 13.7.1 Fasting Blood Glucose Values 
(mg/100 ml) for 36 Nonobese, Apparently 
Healthy, Adult Males 


75 92 80 80 84 72 
84 77 81 77 75 81 
80 92 72 77 78 76 
77 86 77 92 80 78 
68 78 92 68 80 81 


87 76 80 87 77 86 


700  cHAPTER 13 NONPARAMETRIC AND DISTRIBUTION-FREE STATISTICS 


TABLE 13.7.2 Values of Fs(x) for 
Example 13.7.1 


Cumulative 
x Frequency Frequency Fs(x) 
68 2 2 .0556 
72 2 4 .1111 
75 2 6 .1667 
76 2 8 .2222 
77 6 14 .3889 
78 3 17 .4722 
80 6 23 .6389 
81 3 26 .7222 
84 2 28 .7778 
86 2 30 .8333 
87 2 32 .8889 
92 4 36 1.0000 
36 


Each value of Fs(x) is obtained by dividing the corresponding 
cumulative frequency by the sample size. For example, the first value of 
Fs(x) = 2/36 = .0556. 

We obtain values of Рт(х) by first converting each observed value 
of x to a value of the standard normal variable, z. From Appendix 
Table D we then find the area between —oo and z. From these areas we 
are able to compute values of F7(x). The procedure, which is similar to 
that used to obtain expected relative frequencies in the chi-square 
goodness-of-fit test, is summarized in Table 13.7.3. 


TABLE 13.7.3 Steps in Calculation 
of Fr(x) for Example 13.7.1 


x z= (x — 80)/6 Fr(x) 
68 —2.00 .0228 
72 —1.33 .0918 
75 —.83 .2033 
76 —.67 .2514 
77 —.50 .3085 
78 —.33 .3707 
80 .00 .5000 
81 .17 .5675 
84 .67 .7486 
86 1.00 .8413 
87 1.17 .8790 


92 2.00 .9772 


= 
э M Qo RU Oo«^ot20 
oooóoóooóo0óo0ó000 


Cumulative relative frequency 
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- 


68 


FIGURE 13.7.1 


9. 
10. 


70 
Fs(x) and Fr(x) for Example 13.7.1. 


The test statistic D may be computed algebraically, or it may be 
determined graphically by actually measuring the largest vertical dis- 
tance between the curves of Fs(x) and Ет(х) on a graph. The graphs of 
the two distributions are shown in Figure 13.7.1. 

Examination of the graphs of Fs(x) and Fr(x) reveals that 
D = .16 = (.72 — .56). Now let us compute the value of D algebrai- 
cally. The possible values of |Fs(x) — Fr(x)| are shown in Table 13.7.4. 
This table shows that the exact value of D is .1547. 


Statistical decision. Reference to Table M reveals that a computed D of 
.1547 is not significant at any reasonable level. Therefore, we are not 
willing to reject Ho. 

Conclusion. The sample may have come from the specified distribution. 


p value. Since we have a two-sided test, and since .1547 « .174, we 
have p » .20. 


TABLE 13.7.4 Calculation of |F;(x) – Fr(x)| 
for Example 13.7.1 


x Fs(x) 

68 0556 
72 1111 
75 1667 
76 .2222 
77 .3889 
78 .4722 
80 .6389 
81 7222 
84 .7778 
86 .8333 
87 .8889 
92 1.0000 


Fr(x) IFs(x) — Fr(x)| 
.0228 0328 
.0918 0193 
.2033 0366 
2514 0292 
3085 .0804 
3707 .1015 
5000 1389 
.5675 1547 
7486 .0292 
8413 .0080 
.8790 0099 
9772 0228 
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Kolmogorov-Smirnov One-Sample Test 


kolmagoroy (response = glucose, method = asymp, di = na ( mean = 80, stddev = 6 ), time limit = попе ); 


Data File: 
Column Variable: Glucose 


Sample Size: 36 


Summary of the Test Statistic: 


Type Mean Std. Dev 


Hypothesized distribution F(x} Normal 80 6 


Let 5(Х) be the empirical distribution. 


Inference: 


Statistic 


Item Sup{|S(X} - F(X)| } | SuptS(X) -F(X)) | SupiF(X) - 5(Х)) 


Observed Statistic 0,156 0.09122 
| Stand. Statistic 0,9362 0,5473 


Asymptotic p-value 0,3447 0,1732 0,5493 


FIGURE 13.7.2 StatXact output for Example 13.7.1 


StatXact is often used for nonparametric statistical analysis. This particular software 
program has a nonparametric module that contains nearly all of the commonly used 
nonparametric tests, and many less common, but useful, procedures as well. Computer 
analysis using StatXact for the data in Example 13.7.1 is shown in Figure 13.7.2. 
Note that it provides the test statistic of D — 0.156 and the exact two-sided p value 
of .3447. 


A Precaution The reader should be aware that in determining the value of D, it is 
not always sufficient to compute and choose from the possible values of |Fs(x) — Ет(х)|. 
The largest vertical distance between Fs(x) and Ет(х) may not occur at an observed value, 
x, but at some other value of X. Such a situation is illustrated in Figure 13.7.3. We see that if 
only values of |Fs(x) — Ет(х)| at the left endpoints of the horizontal bars are considered, 
we would incorrectly compute D as |.2 — .4| = .2. One can see by examining the graph, 
however, that the largest vertical distance between Fs(x) and Рт(х) occurs at the right 
endpoint of the horizontal bar originating at the point corresponding to x — .4, and the 
correct value of D is |.5 — .2| = 3. 

One can determine the correct value of D algebraically by computing, in addition to 
the differences |Fs(x) — Fr(x)|, the differences |Fs(x;-1) — Fr(x;)| for all values of 
i=1,2,...,r+1, where r= the number of different values of x and Fs(xo) = 0. 
The correct value of the test statistic will then be 


D= maximum (maximum[|Fs(x;) = Fr(x;)|, |Fs(xi-1) = Fr(xi)]]] (13.7.2) 
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FIGURE 13.7.3 Graph of fictitious data showing correct calculation of D. 


Advantages and Disadvantages The following are some important points 
of comparison between the Kolmogorov-Smirnov and the chi-square goodness-of-fit tests. 


1. 


EXERCISES 


The Kolmogorov-Smirnov test does not require that the observations be grouped as 
1s the case with the chi-square test. The consequence of this difference is that the 
Kolmogorov-Smirnov test makes use of all the information present in a set of data. 


. The Kolmogorov-Smirnov test can be used with any size sample. It will be recalled 


that certain minimum sample sizes are required for the use of the chi-square test. 


. As has been noted, the Kolmogorov—Smirnov test is not applicable when parameters 


have to be estimated from the sample. The chi-square test may be used in these 
situations by reducing the degrees of freedom by 1 for each parameter estimated. 


The problem of the assumption of a continuous theoretical distribution has already 
been mentioned. 


13.7.1 The weights at autopsy of the brains of 25 adults suffering from a certain disease were as follows: 


Weight of Brain (grams) 
859 1073 1041 1166 1117 
962 1051 1064 1141 1202 
973 1001 1016 1168 1255 
904 1012 1002 1146 1233 
920 1039 1086 1140 1348 
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13.7.2 


13.7.3 


Can one conclude from these data that the sampled population is not normally distributed with a mean 
of 1050 and a standard deviation of 50? Determine the p value for this test. 


IQs of a sample of 30 adolescents arrested for drug abuse in a certain metropolitan jurisdiction were 
as follows: 


IQ 
95 100 91 106 109 110 
98 104 97 100 107 119 
92 106 103 106 105 112 
101 91 105 102 101 110 
101 95 102 104 107 118 


Do these data provide sufficient evidence that the sampled population of IQ scores is not normally 
distributed with a mean of 105 and a standard deviation of 10? Determine the p value. 


For a sample of apparently normal subjects who served as controls in an experiment, the following 
systolic blood pressure readings were recorded at the beginning of the experiment: 


162 177 151 167 
130 154 179 146 
147 157 141 157 
153 157 134 143 
141 137 151 161 


Can one conclude on the basis of these data that the population of blood pressures from 
which the sample was drawn is not normally distributed with и = 150 and o = 12? Determine 
the p value. 


13.8 THE KRUSKAL-WALLIS ONE-WAY 
ANALYSIS OF VARIANCE BY RANKS 


In Chapter 8 we discuss how one-way analysis of variance may be used to test the null 
hypothesis that several population means are equal. When the assumptions underlying this 
technique are not met, that is, when the populations from which the samples are drawn are 
not normally distributed with equal variances, or when the data for analysis consist only of 
ranks, a nonparametric alternative to the one-way analysis of variance may be used to test 
the hypothesis of equal location parameters. As was pointed out in Section 13.5, the median 
test may be extended to accommodate the situation involving more than two samples. A 
deficiency of this test, however, is the fact that it uses only a small amount of the 
information available. The test uses only information as to whether or not the observations 
are above or below a single number, the median of the combined samples. The test does not 
directly use measurements of known quantity. Several nonparametric analogs to analysis of 
variance are available that use more information by taking into account the magnitude of 
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each observation relative to the magnitude of every other observation. Perhaps the best 
known of these procedures is the Kruskal-Wallis one-way analysis of variance by 
ranks (8). 


The Kruskal-Wallis Procedure The application of the test involves the 
following steps. 


1. The пі, и2,..., ny observations from the k samples are combined into a single 
series of size n and arranged in order of magnitude from smallest to largest. 
The observations are then replaced by ranks from 1, which is assigned to the 
smallest observation, to n, which is assigned to the largest observation. When two 
or more observations have the same value, each observation is given the mean of 
the ranks for which it is tied. 


2. The ranks assigned to observations in each of the k groups are added separately to 
give k rank sums. 


3. The test statistic 


R2 
—- 1) 13.8.1 
CEN imu -ahna (13.8.1) 
res А 
is computed. In Equation 13.8.1, 
k = the number of samples 
nj = the number of observations in the jth sample 
n = the number of observations in all samples combined 


R; = the sum of the ranks in the jth sample 


4. When there are three samples and five or fewer observations in each sample, the 
significance of the computed H is determined by consulting Appendix Table N. 
When there are more than five observations in one or more of the samples, H is 
compared with tabulated values of x? with k — 1 degrees of freedom. 


EXAMPLE 13.8.1 


In a study of pulmonary effects on guinea pigs, Lacroix et al. (A-7) exposed 
ovalbumin (OA)-sensitized guinea pigs to regular air, benzaldehyde, or acetaldehyde. 
At the end of exposure, the guinea pigs were anesthetized and allergic responses were 
assessed in bronchoalveolar lavage (BAL). One of the outcome variables examined 
was the count of eosinophil cells, a type of white blood cell that can increase with 
allergies. Table 13.8.1 gives the eosinophil cell count (x 109) for the three treatment 
groups. 

Can we conclude that the three populations represented by the three samples differ 
with respect to eosinophil cell count? We can so conclude if we can reject the null 
hypothesis that the three populations do not differ in eosinophil cell count. 
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TABLE 13.8.1 


Eosinophil Count for 


Ovalbumin-Sensitized Guinea Pigs 


Eosinophil Cell Count (x 109) 


Air Benzaldehyde Acetaldehyde 
12.22 3.68 54.36 
28.44 4.05 27.87 
28.13 6.47 66.81 
38.69 21.12 46.27 
54.91 3.33 30.19 


Source: Data provided courtesy of G. Lacroix. 


Solution: 


. Data. See Table 13.8.1. 


2. Assumptions. The samples are independent random samples from their 


respective populations. The measurement scale employed is at least 
ordinal. The distributions of the values in the sampled populations are 
identical except for the possibility that one or more of the populations 
are composed of values that tend to be larger than those of the other 
populations. 


. Hypotheses. 


Ho: The population centers are all equal. 


Ha: At least one of the populations tends to exhibit larger values 
than at least one of the other populations. 


Let a = .01. 


. Test statistic. See Equation 13.8.1. 


. Distribution of test statistic. Critical values of H for various sample 


sizes and o levels are given in Appendix Table М. 


. Decision rule. The null hypothesis will be rejected if the computed 


value of H is so large that the probability of obtaining a value that large 
or larger when Не is true is equal to or less than the chosen significance 
level, o. 


Calculation of test statistic. When the three samples are combined into 
a single series and ranked, the table of ranks shown in Table 13.8.2 may 
be constructed. 

The null hypothesis implies that the observations in the three 
samples constitute a single sample of size 15 from a single population. 
If this is true, we would expect the ranks to be well distributed among 
the three groups. Consequently, we would expect the total sum of 
ranks to be divided among the three groups in proportion to group size. 
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TABLE 13.8.2 The Data of Table 13.8.1 
Replaced by Ranks 


Air Benzaldehyde Acetaldehyde 
5 2 13 
9 3 7 
8 4 15 

11 6 12 

14 1 10 

Ву = 47 Я» = 16 Вз = 57 


Departures from these conditions are reflected in the magnitude of the 
test statistics H. 
From the data in Table 13.8.2 and Equation 13.8.1, we obtain 


Е E (16)? (57)? 


2 3(15 + 1) = 9.14 
15(16) Oe eae 


8. Statistical decision. Table N shows that when the n; are 5, 5, and 5, the 
probability of obtaining a value of A = 9.14 is less than .009. The null 
hypothesis can be rejected at the .01 level of significance. 


9. Conclusion. We conclude that there is a difference in the average 
eosinophil cell count among the three populations. 


10. p value. For this test, p « .009. и 


Ties When ties occur among the observations, we may adjust the value of Н by 
dividing it by 


jaa (13.8.2) 


m-n 


where T = f? — t. The letter t is used to designate the number of tied observations in a 
group of tied values. In our example there are no groups of tied values but, in general, there 
may be several groups of tied values resulting in several values of T. 

The effect of the adjustment for ties is usually negligible. Note also that the effect of 
the adjustment is to increase H, so that if the unadjusted H is significant at the chosen level, 
there is no need to apply the adjustment. 


More than Three Samples/Large Samples Now let us illustrate the 
procedure when there are more than three samples and at least one of the n; is greater 
than 5. 
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TABLE 13.8.3 Net Book Value of Equipment per Bed by Hospital Type 


Type Hospital 
A B с р Е 
$1735(11) $5260(35) $2790(20) $3475(26) $6090(40) 
1520(2) 4455(28) 2400(12) 3115(22) 6000(38) 
1476(1) 4480(29) 2655(16) 3050(21) 5894(37) 
1688(7) 4325(27) 2500(13) 3125(23) 5705(36) 
1702(10) 5075(32) 2755(19) 3275(24) 6050(39) 
2667(17) 5225(34) 2592(14) 3300(25) 6150(41) 
1575(4) 4613(30) 2601(15) 2730(18) 5110(33) 
1602(5) 4887(31) 1648(6) 
1530(3) 1700(9) 
1698(8) 
В. = 68 R2 = 246 Вз = 124 R, = 159 Rs = 264 


EXAMPLE 13.8.2 


Table 13.8.3 shows the net book value of equipment capital per bed for a sample of 
hospitals from each of five types of hospitals. We wish to determine, by means of the 
Kruskal-Wallis test, if we can conclude that the average net book value of equipment 
capital per bed differs among the five types of hospitals. The ranks of the 41 values, along 
with the sum of ranks for each sample, are shown in the table. 


Solution: From the sums of the ranks we compute 
12 (68) (246) (124)? (159? (264)? 


H = 
Was) dO п 8 .48977 e 7 74 
— 36.39 


3(41 +1) 


Reference to Appendix Table F with k — 1 — 4 degrees of freedom indi- 
cates that the probability of obtaining a value of H as large as or larger than 
36.39, due to chance alone, when there is no difference among the 
populations, is less than .005. We conclude, then, that there is a difference 
among the five populations with respect to the average value of the variable 
of interest. и 


Computer Analysis The MINITAB software package computes the Kruskal- 
Wallis test statistic and provides additional information. After we enter the eosinophil 
counts in Table 13.8.1 into Column 1 and the group codes into Column 2, the MINITAB 
procedure and output are as shown in Figure 13.8.1. 
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Data: 
C1: 12.22 28.44 28.13 38.69 54.91 3.68 4.05 6.47 21.12 3.33 54.36 27.87 66.81 46.27 30.19 
Qz qo ELt15:2 22.2 2.3.33 3 З 


Dialog box: Session command: 


Stat » Nonparametrics » Kruskal-Wallis MTB » Kruskal-Wallis C1 C2. 
Type СІ in Response and C2 in Factor. Click OK. 


Output: 
Kruskal-Wallis Test: C1 versus C2 
Kruskal-Wallis Test on C1 


Median 
28.440 
4.050 
46.270 
Overall 


9.14 


FIGURE 13.8.1 МІМІТАВ procedure and output, Kruskal-Wallis test of eosinophil count data in 
Table 13.8.1. 


EXERCISES 


For the following exercises, perform the test at the indicated level of significance and determine the 
p value. 


13.8.1 In a study of healthy subjects grouped by age (Younger: 19-50 years, Seniors: 65-75 years, and 
Longeval: 85-102 years), Herrmann et al. (A-8) measured their vitamin B-12 levels (ng/L). All 
elderly subjects were living at home and able to carry out normal day-to-day activities. The following 
table shows vitamin B-12 levels for 50 subjects in the young group, 92 seniors, and 90 subjects in the 
longeval group. 


Young (19-50 Years) Senior (65-75 Years) Longeval (85-102 Years) 

230 241 319 371 566 170 148 149 631 198 
477 442 190 460 290 542 1941 409 305 321 
561 491 461 440 271 282 128 229 393 2772 
347 279 163 520 308 194 145 183 282 428 
566 334 377 256 440 445 174 193 273 259 
260 247 190 335 238 921 495 161 157 111 


(Continued) 
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13.8.2 


13.8.3 


Young (19-50 Years) 


300 
230 
215 
260 
349 
315 
257 
536 
582 
293 
569 
325 
275 
172 
2000 
240 
235 
284 
883 


314 
254 
419 
335 
455 
297 
456 
668 
240 
320 
562 
360 
357 
609 
740 
430 
645 
395 
302 


375 
229 
193 
294 
740 
194 
780 
245 
258 
419 
372 
413 
685 
136 
441 
423 
617 
985 
170 


Senior (65-75 Years) 


137 
452 
437 
236 
432 
411 
268 
703 
282 
290 
286 
143 
310 
352 
262 
404 
380 
322 
340 


525 
298 
153 
323 
205 
248 
371 
668 
197 
260 
198 
336 
421 
712 
461 
631 
1247 
1033 
285 


1192 
748 
187 
350 

1365 
232 
509 
357 
201 
177 
872 


Longeval (85-102 Years) 


460 
548 
198 
165 
226 
557 
166 
218 
186 
346 
239 
240 
136 
359 
715 
252 
414 
372 
236 


400 
348 
175 
540 
293 
196 
632 
438 
368 
262 
190 
241 
195 
220 
164 
279 
297 
474 
375 


1270 
252 
262 
381 
162 
340 
370 
483 
222 
2T] 
226 
203 
369 
162 

95 
178 
530 
334 
521 


262 
161 
1113 
409 
378 
203 
221 
917 
244 


Source: Data provided courtesy of W. Herrmann and H. Schorr. 


May we conclude, on the basis of these data, that the populations represented by these samples differ 


with respect to vitamin B-12 levels? Let a = .01. 


The following are outpatient charges (—$100) made to patients for a certain surgical procedure by 
samples of hospitals located in three different areas of the country: 


Area 
I II ПІ 
580.75 558.63 584.21 
78.15 72.70 101.76 
85.40 64.20 107.74 
71.94 62.50 115.30 
82.05 63.24 126.15 


Can we conclude at the .05 level of significance that the three areas differ with respect to the charges? 


A study of young children by Flexer et al. (A-9) published in the Hearing Journal examines the 
effectiveness of an FM sound field when teaching phonics to children. In the study, children in a 
classroom with no phonological or phonemic awareness training (control) were compared to a class 
with phonological and phonemic awareness (PPA) and to a class that utilized phonological and 
phonemic awareness training and the FM sound field (PPA/FM). A total of 53 students from three 
separate preschool classrooms participated in this study. Students were given a measure of phonemic 
awareness in preschool and then at the end of the first semester of kindergarten. The improvement 
scores are listed in the following table as measured by the Yopp-Singer Test of Phonemic 


Segmentation. 


13.8.4 


13.8.5 
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Improvement (Control) Improvement PPA Improvement PPA/FM 
0 1 2 1 19 
-1 1 3 3 20 
0 2 15 7 21 
1 2 18 9 21 
4 3 19 11 22 
5 6 20 17 22 
9 7 5 17 15 
9 8 17 17 
13 9 18 17 
18 18 18 19 
0 20 19 22 
0 19 


Source: Data provided courtesy of John P. Holcomb, Jr., Ph.D. 


Test for a significant difference among the three groups. Let a = .05. 


Refer to Example 13.8.1. Another variable of interest to Lacroix et al. (A-7) was the number of 
alveolar cells in three groups of subjects exposed to air, benzaldehyde, or acetaldehyde. The 
following table gives the information for six guinea pigs in each of the three treatment groups. 


Number of Alveolar Cells (x 10%) 


Air Benzaldehyde Acetaldehyde 

0.55 0.81 0.65 

0.48 0.56 13.69 

7.8 1.11 17.11 

8.72 0.74 7.43 

0.65 0.77 5.48 

1.51 0.83 0.99 Source: Data provided courtesy 
0.55 0.81 0.65 of G. Lacroix. 


May we conclude, on the basis of these data, that the number of alveolar cells in ovalbumin-sensitized 
guinea pigs differs with type of exposure? Let o = .05. 


The following table shows the pesticide residue levels (ppb) in blood samples from four populations 
of human subjects. Use the Kruskal-Wallis test to test at the .05 level of significance the null 
hypothesis that there is no difference among the populations with respect to average level of pesticide 
residue. 


Population Population 
A B С D A B С D 
10 4 15 7 44 11 9 4 
37 35 5 11 12 7 11 5 
12 32 10 10 15 32 2 


(Continued) 
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Population Population 
A B С D A B С D 
31 19 12 8 42 17 14 6 
11 33 6 2 23 8 15 3 
9 18 6 5 


13.8.6 Hepatic y-glutamyl transpeptidase (GGTP) activity was measured in 22 patients undergoing 
percutaneous liver biopsy. The results were as follows: 


Subject Diagnosis Hepatic GGTP Level 
1 Normal liver 27.7 
2 Primary biliary cirrhosis 45.9 
3 Alcoholic liver disease 85.3 
4 Primary biliary cirrhosis 39.0 
5 Normal liver 25.8 
6 Persistent hepatitis 39.6 
7 Chronic active hepatitis 41.8 
8 Alcoholic liver disease 64.1 
9 Persistent hepatitis 41.1 

10 Persistent hepatitis 35:3 

11 Alcoholic liver disease 71.5 

12 Primary biliary cirrhosis 40.9 

13 Normal liver 38.1 

14 Primary biliary cirrhosis 40.4 

15 Primary biliary cirrhosis 34.0 

16 Alcoholic liver disease 74.4 

17 Alcoholic liver disease 78.2 

18 Persistent hepatitis 32.6 

19 Chronic active hepatitis 46.3 

20 Normal liver 39.6 

21 Chronic active hepatitis 52.7 

22 Chronic active hepatitis 57.2 


Can we conclude from these sample data that the average population GGTP level differs among the 
five diagnostic groups? Let o = .05 and find the p value. 


13.9 THE FRIEDMAN TWO-WAY ANALYSIS 
OF VARIANCE BY RANKS 


Just as we may on occasion have need of a nonparametric analog to the parametric one-way 
analysis of variance, we may also find it necessary to analyze the data in a two-way 
classification by nonparametric methods analogous to the two-way analysis of variance. 
Such a need may arise because the assumptions necessary for parametric analysis of 
variance are not met, because the measurement scale employed is weak, or because results 
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are needed in a hurry. A test frequently employed under these circumstances is the 
Friedman two-way analysis of variance by ranks (9,10). This test is appropriate whenever 
the data are measured on, at least, an ordinal scale and can be meaningfully arranged in a 
two-way classification as is given for the randomized block experiment discussed in 
Chapter 8. The following example illustrates this procedure. 


EXAMPLE 13.9.1 


A physical therapist conducted a study to compare three models of low-volt electrical 
stimulators. Nine other physical therapists were asked to rank the stimulators in order of 
preference. A rank of 1 indicates first preference. The results are shown in Table 13.9.1. We 
wish to know if we can conclude that the models are not preferred equally. 


Solution: 


1. Data. See Table 13.9.1. 


2. Assumptions. The observations appearing in a given block are inde- 
pendent of the observations appearing in each of the other blocks, and 
within each block measurement on at least an ordinal scale is achieved. 

3. Hypothesis. In general, the hypotheses are: 

Ho: The treatments all have identical effects. 
На: At least one treatment tends to yield larger observations than 
at least one of the other treatments. 
For our present example we state the hypotheses as follows: 
Ho: The three models are equally preferred. 
Ha: The three models are not equally preferred. 


Let a = .05. 


TABLE 13.9.1 Physical Therapists' Rankings of 
Three Models of Low-Volt Electrical Stimulators 


Model 


» 


Therapist B 
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4. Test statistic. By means of the Friedman test we will be able to 
determine if it is reasonable to assume that the columns of ranks 
have been drawn from the same population. If the null hypothesis is 
true we would expect the observed distribution of ranks within any 
column to be the result of chance factors and, hence, we would expect 
the numbers 1, 2, and 3 to occur with approximately the same frequency 
in each column. If, on the other hand, the null hypothesis is false (that is, 
the models are not equally preferred), we would expect a preponderance 
of relatively high (or low) ranks in at least one column. This condition 
would be reflected in the sums of the ranks. The Friedman test will tell 
us whether or not the observed sums of ranks are so discrepant that it is 
not likely they are a result of chance when Но is true. 

Since the data already consist of rankings within blocks (rows), our 
first step is to sum the ranks within each column (treatment). These sums 
are the К; shown in Table 13.9.1. A test statistic, denoted by Friedman as 
x2, is computed as follows: 


2 = 12 > Я 2 == 
X = т) (®) - +1) (13.9.1) 


j=l 
where n = the number of rows (blocks) and k = the number of columns 
(treatments). 


5. Distribution of test statistic. Critical values for various values of n and 
k are given in Appendix Table O. 


6. Decision rule. Reject Ho if the probability of obtaining (when Hj is 
true) a value of x? as large as or larger than actually computed is less 
than or equal to o. 


7. Calculation of test statistic. Using the data in Table 13.9.1 and 
Equations 13.9.1, we compute 


12 


2 2 2 2 
= — | (15) + (25) + (14)7| — 3(9)(3 + 1) = 8.222 
X = оду c1; (09 + 09 + 047] -36)8+1 
8. Statistical decision. When we consult Appendix Table Oa, we find that 
the probability of obtaining a value of xi as large as 8.222 due to chance 
alone, when the null hypothesis is true, is .016. We are able, therefore, to 


reject the null hypothesis. 
9. Conclusion. We conclude that the three models of low-volt electrical 
stimulator are not equally preferred. 


10. p value. For this test, p — .016. и 


Ties When the original data consist of measurements on an interval or a ratio scale 
instead of ranks, the measurements are assigned ranks based on their relative magnitudes 
within blocks. If ties occur, each value is assigned the mean of the ranks for which it 
is tied. 
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Large Samples When the values of k and/or n exceed those given in Table O, the 
critical value of x: is obtained by consulting the x? table (Table Е) with the chosen о and 
k — 1 degrees of freedom. 


EXAMPLE 13.9.2 


Table 13.9.2 shows the responses, in percent decrease in salivary flow, of 16 experimental 
animals following different dose levels of atropine. The ranks (in parentheses) and the sum 
of the ranks are also given in the table. We wish to see if we may conclude that the different 
dose levels produce different responses. That is, we wish to test the null hypothesis of no 
difference in response among the four dose levels. 


Solution: From the data, we compute 
12 
16(4)(4 4- 1) 

Reference to Table F indicates that with k — 1 — 3 degrees of freedom 
the probability of getting a value of x as large as 30.32 due to chance alone 


is, when Но is true, less than .005. We reject the null hypothesis and conclude 
that the different dose levels do produce different responses. 


= [Eoy + (36.5)? + (44)? + (59.5)?] — 3(16)(4 + 1) = 30.32 


TABLE 13.9.2 Percent Decrease in Salivary Flow of 
Experimental Animals Following Different Dose 
Levels of Atropine 


Dose Level 

Animal Number A B С р 

1 29(1) 48(2) 75(3) 100(4) 
2 72(2) 30(1) 100(3.5) 100(3.5) 
3 70(1) 100(4) 86(2) 96(3) 
4 54(2) 35(1) 90(3) 99(4) 
5 5(1) 43(3) 32(2) 81(4) 
6 1701) 40(2) 76(3) 81(4) 
7 74(1) 100(3) 100(3) 100(3) 
8 6(1) 34(2) 60(3) 81(4) 
9 16(1) 39(2) 73(3) 79(4) 
10 52(2) 34(1) 88(3) 96(4) 
11 8(1) 42(3) 31(2) 79(4) 
12 29(1) 47(2) 72(3) 99(4) 
13 71(1) 100(3.5) 97(2) 100(3.5) 
14 7(1) 33(2) 58(3) 79(4) 
15 68(1) 99(4) 84(2) 93(3) 
16 70(2) 30(1) 99(3.5) 99(3.5) 
Rj 20 36.5 44 59.5 
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Dialog box: Session command: 


Stat » Nonparametrics » Friedman MTB » FRIEDMAN C3 C1 C2 


Type C3 in Response, C/ in Treatment and C2 in 
Blocks. Click OK. 


Output: 

Friedman Test: C3 versus C1 blocked by C2 
8.22 d.f. = = 0.017 

Est. 

Median 

2.0000 


2.6667 
1.3333 


Grand median = 2.0000 


FIGURE 13.9.1 MINITAB procedure and output for Example 13.9.1. 


Computer Analysis Many statistics software packages, including MINITAB, 
will perform the Friedman test. To use MINITAB we form three columns of data. We may, 
for example, set up the columns so that Column 1 contains numbers that indicate the 
treatment to which the observations belong, Column 2 contains numbers indicating the 
blocks to which the observations belong, and Column 3 contains the observations. If we do 
this for Example 13.9.1, the MINITAB procedure and output are as shown in Figure 13.9.1. 


EXERCISES 


For the following exercises perform the test at the indicated level of significance and determine the 
p value. 


13.9.1 The following table shows the scores made by nine randomly selected student nurses on final 
examinations in three subject areas: 


Subject Area 
Student 
Number Fundamentals Physiology Anatomy 
1 98 95 79 
95 71 79 


(Continued) 
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13.9.3 


EXERCISES 717 


Subject Area 
Student ee o 
Number Fundamentals Physiology Anatomy 
3 76 80 91 
4 95 81 84 
5 83 77 80 
6 99 70 93 
7 82 80 87 
8 75 72 81 
9 88 81 83 


Test the null hypothesis that student nurses constituting the population from which the above sample 
was drawn perform equally well in all three subject areas against the alternative hypothesis that they 
perform better in, at least, one area. Let a = .05. 


Fifteen randomly selected physical therapy students were given the following instructions: “Assume 
that you will marry a person with one of the following handicaps (the handicaps were listed and 
designated by the letters A to J). Rank these handicaps from 1 to 10 according to your first, second, 
third (and so on) choice of a handicap for your marriage partner." The results are shown in the 
following table. 


Handicap 


Student Number 
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Test the null hypothesis of no preference for handicaps against the alternative that some handicaps are 
preferred over others. Let о = .05. 


Ten subjects with exercise-induced asthma participated in an experiment to compare the 
protective effect of a drug administered in four dose levels. Saline was used as a control. The 
variable of interest was change in FEV, after administration of the drug or saline. The results 
were as follows: 
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Dose Level of Drug (mg/ml) 


Subject Saline 2 10 20 40 
1 —.68 32 14 21 32 
2 —1.55 .56 .31 21 .16 
3 —1.41 .28 11 .08 .83 
4 —.76 .56 .24 41 08 
5 —.48 25 17 04 .18 
6 -3.12 -199  —122 —.55 - 15 
7 -1.16 .88 .87 .54 .84 
8 —1.15 31 18 ‚07 .09 
9 —.78 .24 .39 11 .51 

10 -2.12 35 .28 F.11 41 


Can one conclude on the basis of these data that different dose levels have different effects? 
Let о = .05 and find the p value. 


13.10 THE SPEARMAN RANK 
CORRELATION COEFFICIENT 


Several nonparametric measures of correlation are available to the researcher. Of these a 
frequently used procedure that is attractive because of the simplicity of the calculations 
involved is due to Spearman (11). The measure of correlation computed by this method is 
called the Spearman rank correlation coefficient and is designated by r,. This procedure 
makes use of the two sets of ranks that may be assigned to the sample values of X and Y, the 
independent and continuous variables of a bivariate distribution. 


Hypotheses The usually tested hypotheses and their alternatives are as follows: 


(a) Ho: X and Y are mutually independent. 
На: X and Y are not mutually independent. 


(b) Ho: X and Y are mutually independent. 
Ha: There is a tendency for large values of X and large values of Y to be paired 
together. 


(c) Ho: X and Y are mutually independent. 
Ha: There is a tendency for large values of X to be paired with small values of Y 


The hypotheses specified in (a) lead to a two-sided test and are used when it is desired 
to detect any departure from independence. The one-sided tests indicated by (b) and (c) are 
used, respectively, when investigators wish to know if they can conclude that the variables 
are directly or inversely correlated. 


The Procedure The hypothesis-testing procedure involves the following steps. 


1. Rank the values of X from 1 to п (numbers of pairs of values of X and Yin the sample). 
Rank the values of Y from 1 to n. 


13.10 THE SPEARMAN RANK CORRELATION COEFFICIENT 719 


2. Compute d; for each pair of observations by subtracting the rank of Y; from the 
rank of X;. 


3. Square each d; and compute У) Ф, the sum of the squared values. 


4. Compute 


674; 


Se (13.10.1) 


Г; = 


5. If nis between 4 and 30, compare the computed value of r, with the critical values, гу, 
of Appendix Table Р. For the two-sided test, Но is rejected at the o significance level 
if г, is greater than rž or less than —rž, where r; is at the intersection of the column 
headed о /2 and the row corresponding to п. For the one-sided test with НА specifying 
direct correlation, Но is rejected at the o significance level if г, is greater than г; foro 
and n. The null hypothesis is rejected at the o significance level in the other one-sided 
test if г, is less than —7; for o and n. 


6. If n is greater than 30, one may compute 


= муп 1 (13.10.2) 


and use Appendix Table D to obtain critical values. 


7. Tied observations present a problem. The use of Table P is strictly valid only when 
the data do not contain any ties (unless some random procedure for breaking ties is 
employed). In practice, however, the table is frequently used after some other method 
for handling ties has been employed. If the number of ties is large, the following 
correction for ties may be employed: 


Pt 
12 


where t = the number of observations that are tied for some particular rank. When 
this correction factor is used, r, is computed from 


EXI 
ES (13.10.4) 


T= 


(13.10.3) 


Fs 


instead of from Equation 13.10.1. 
In Equation 13.10.4, 


3 
2 WW —n 
xxm 2.5 
n—n 
Dy = 12 - M, 


T, — the sum of the values of T for the various tied ranks in X 
T, — the sum of the values of T for the various tied ranks in Y 


Most authorities agree that unless the number of ties is excessive, the correction makes 
very little difference in the value of r,. When the number of ties is small, we can follow the 
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usual procedure of assigning the tied observations the mean of the ranks for which they are 
tied and proceed with steps 2 to 6. 


EXAMPLE 13.10.1 


In a study of the relationship between age and the EEG, data were collected on 20 subjects 
between ages 20 and 60 years. Table 13.10.1 shows the age and a particular EEG output 
value for each of the 20 subjects. The investigator wishes to know if it can be concluded that 
this particular EEG output is inversely correlated with age. 


Solution: 


. Data. See Table 13.10.1. 


. Assumptions. We assume that the sample available for analysis is a 


simple random sample and that both X and Yare measured on at least the 
ordinal scale. 


. Hypotheses. 


Но: This EEG output and age are mutually independent. 
Ha: There is a tendency for this EEG output to decrease with age. 


Suppose we let o — .05. 


TABLE 13.10.1 Age and EEG Output 
Value for 20 Subjects 


Subject EEG Output 
Number Age (X) Value (Y) 
1 20 98 
2 21 75 
3 22 95 
4 24 100 
5 27 99 
6 30 65 
7 31 64 
8 33 70 
9 35 85 
10 38 74 
11 40 68 
12 42 66 
13 44 71 
14 46 62 
15 48 69 
16 51 54 
17 53 63 
18 55 52 
19 58 67 
20 60 55 


9. 
10. 


TABLE 13.10.2 
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Test statistic. See Equation 13.10.1. 


Distribution of test statistic. Critical values of the test statistic are 
given in Appendix Table P. 


Decision rule. For the present test we will reject Но if the computed 
value of r, is less than —.3789. 


Calculation of test statistic. When the X and Y values are ranked, we 
have the results shown in Table 13.10.2. The dj, Ф, апа У; а аге shown 
in the same table. 

Substitution of the data from Table 13.10.2 into Equation 13.10.1 
gives 


6(2340) 
fs = = 
| 20[(20)? — 1] 
Statistical decision. Since our computed г, = —.76 is less than the 


critical их, we reject the null hypothesis. 
Conclusion. We conclude that the two variables are inversely related. 
p value. Since —.76 « —0.6586, we have for this test p « .001. 


Ranks for Data of Example 13.10.1 


Subject 
Number Rank (X) Rank (Y) d; а? 
1 1 18 -17 289 
2 2 15 -13 169 
3 3 17 -14 196 
4 4 20 -16 256 
5 5 19 -14 196 
6 6 7 -1 1 
7 7 6 1 1 
8 8 12 -4 16 
9 9 16 -7 49 
10 10 14 -4 16 
11 11 10 1 1 
12 12 8 16 
13 13 13 0 0 
14 14 4 10 100 
15 15 11 4 16 
16 16 2 14 196 
17 17 5 12 144 
18 18 1 17 289 
19 19 9 10 100 
20 20 3 17 289 
Уа? = 2340 
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Let us now illustrate the procedure for a sample with по» 30 and some tied 
observations. 


EXAMPLE 13.10.2 


In Table 13.10.3 are shown the ages and concentrations (ppm) of a certain mineral in the 
tissue of 35 subjects on whom autopsies were performed as part of a large research 
project. 

The ranks, d;, d and У; d are shown in Table 13.10.4. Let us test, at the .05 level of 
significance, the null hypothesis that X and Y are mutually independent against the two- 
sided alternative that they are not mutually independent. 


Solution: From the data in Table 13.10.4 we compute 


Е 6(1788.5) _ 
met 35[(35)? — 1] й 


To test the significance of г, we compute 


z = 75/35 - 1 = 4.37 

TABLE 13.10.3 Age and Mineral Concentration (ppm) т Tissue of 35 Subjects 

Mineral Mineral 
Subject Age Concentration Subject Age Concentration 
Number (X) (Y) Number (X) (Y) 
1 82 169.62 19 50 4.48 
2 85 48.94 20 71 46.93 
3 83 41.16 21 54 30.91 
4 64 63.95 22 62 34.27 
5 82 21.09 23 47 41.44 
6 53 5.40 24 66 109.88 
7 26 6.33 25 34 2.78 
8 47 4.26 26 46 4.17 
9 37 3.62 27 27 6.57 
10 49 4.82 28 54 61.73 
11 65 108.22 29 72 47.59 
12 40 10.20 30 41 10.46 
13 32 2.69 31 35 3.06 
14 50 6.16 32 75 49.57 
15 62 23.87 33 50 5.55 
16 33 2.70 34 76 50.23 
17 36 3.15 35 28 6.81 
18 53 60.59 
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TABLE 13.10.4 Ranks for Data of Example 13.10.2 


Subject Rank Rank Subject Rank Rank 
Number (xX) (У d; d? Number (x) (Y) d; d 
1 32.5 35  -25 6.25 19 17 9 8 64.00 
2 35 27 8 64.00 20 28 25 3 9.00 
3 34 23 11 121.00 21 21.5 21 .5 .25 
4 25 32 -7 49.00 22 23.5 22 1.5 2.25 
5 32.5 19 13.5 182.25 23 13.5 24 —105 110.25 
6 19.5 11 85 7225 24 27 34 -7 49.00 
7 1 14  -13 169.00 25 6 3 3 9.00 
8 13.5 8 5.5 30.25 26 12 7 5 25.00 
9 9 6 3 9.00 27 2 15 -13 169.00 
10 15 10 5 25.00 28 21.5 31 -9.5 90.25 
11 26 33  -7 49.00 29 29 26 3 9.00 
12 10 17  -7 49.00 30 11 18 -7 49.00 
13 4 1 3 9.00 31 7 4 3 9.00 
14 17 13 4 16.00 32 30 28 2 4.00 
15 23.5 20 3.5 12.25 33 17 12 5 25.00 
16 5 2 3 9.00 34 31 29 2 4.00 
17 8 5 3 9.00 35 3 16  -13 169.00 
18 19.5 30  -105 110.25 
Y dí = 1788.5 


Since 4.37 is greater than z = 3.89, p < 2(.0001) = .0002, and we 
reject Но and conclude that the two variables under study are not mutually 
independent. 

For comparative purposes let us correct for ties using Equation 13.10.3 
and then compute r, by Equation 13.10.4. 

In the rankings of X we had six groups of ties that were broken by 
assigning the values 13.5, 17, 19.5, 21.5, 23.5, and 32.5. In five of the groups 
two observations tied, and in one group three observations tied. We, 
therefore, compute five values of 


293—2 6 
Т, E = — = 
12 12 З 
and one value of 
3 
- 24 
Т, = 3 3 = —= 2 
12 12 


From these computations, we have УТ, = 5(.5) + 2 = 4.5, so that 


35? — 35 
2= 4.5 — 3565.5 
уй Sa 
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Dialog box: Session command: 


Stat » Basic Statistics » Correlation МТВ > CORRELATION C3 C4 


Type C3-C4 in Variables. Click OK. 


Output: 
Correlations (Pearson) 


Correlation of (X)Rank and (Y)Rank = 


FIGURE 13.10.1 МІМІТАВ procedure and output for computing Spearman rank correlation 
coefficient, Example 13.10.1. 


Since no ties occurred in the Y rankings, we have У T, = 0 and 
35° — 35 
2 
== 3 — 0 = 3570.0 
кз а 


From Table 13.10.4 we have У d? = 1788.5. From these data we may now 
compute by Equation 13.10.4 


_ 3565.5 + 3570.0 — 17885 _ ,. 
2\/(3565.5)(3570) | 


Fs 


We see that in this case the correction for ties does not make any difference in 
the value of r,. Г] 


Computer Analysis We may use MINITAB, as well as many other statistical 
software packages, to compute the Spearman correlation coefficient. To use MINITAB, we 
must first have MINITAB rank the observations and store the ranks in separate columns, 
one for the X ranks and one for the Y ranks. If we rank the X and Y values of Example 
13.10.1 and store them in Columns 3 and 4, we may obtain the Spearman rank correlation 
coefficient with the procedure shown in Figure 13.10.1. Other software packages such as 
SAS? and SPSS, for example, automatically rank the measurements before computing the 
coefficient, thereby eliminating an extra step in the procedure. 


EXERCISES 


For the following exercises perform the test at the indicated level of significance and determine the 
p value. 


13.10.1 The following table shows 15 randomly selected geographic areas ranked by population density and 
age-adjusted death rate. Can we conclude at the .05 level of significance that population density and 
age-adjusted death rate are not mutually independent? 


13.10.2 


13.10.3 
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Rank by Rank by 

Population Age-Adjusted Population Age-Adjusted 
Area Density (X) Death Rate (Y) Area Density (X) Death Rate (Y) 
1 8 10 9 6 8 
2 2 14 10 14 5 
3 12 4 11 7 6 
4 4 15 12 1 2 
5 9 11 13 13 9 
6 3 1 14 15 3 
7 10 12 15 11 13 
8 5 7 


The following table shows 10 communities ranked by decayed, missing, or filled (DMF) teeth per 100 
children and fluoride concentration in ppm in the public water supply: 


Rank by Rank by 
DMF Teeth Fluoride DMF Teeth Fluoride 
per 100 Concentration per 100 Concentration 
Community Children (X) (Y) Community Children (X) (Y) 
1 8 1 6 4 7 
2 9 3 7 1 10 
3 T: 4 8 5 6 
4 3 9 9 6 5 
5 2 8 10 10 2 


Do these data provide sufficient evidence to indicate that the number of DMF teeth per 100 children 
tends to decrease as fluoride concentration increases? Let a = .05. 


The purpose of a study by Nozawa et al. (A-10) was to evaluate the outcome of surgical repair of pars 
interarticularis defect by segmental wire fixation in young adults with lumbar spondylolysis. The 
authors cite literature indicating that segmental wire fixation has been successful in the treatment of 
nonathletes with spondylolysis and point out that no information existed on the results of this type of 
surgery in athletes. In a retrospective study of subjects having surgery between 1993 and 2000, the 
authors found 20 subjects who had undergone the surgery. The following table shows the age (years) 
at surgery and duration (months) of follow-up care for these subjects. 


Duration of Follow-Up Age Duration of Follow-Up Age 
(Months) (Years) (Months) (Years) 
103 37 38 27 
68 27 36 31 
62 12 34 24 
60 18 30 23 
60 18 19 14 


(Continued) 


726 


CHAPTER 13 NONPARAMETRIC AND DISTRIBUTION-FREE STATISTICS 


13.10.4 


13.10.5 


Duration of Follow-Up Age Duration of Follow-Up Age 
(Months) (Years) (Months) (Years) 
54 28 19 23 
49 25 19 18 
44 20 19 29 
42 18 17 24 
41 30 16 27 


Source: Satoshi Nozawa, Katsuji Shimizu, Kei Miyamoto, апа Mizuo Tanaka, “Кераїг of Pars Interarticularis 
Defect by Segmental Wire Fixation in Young Athletes with Spondylolysis,” American Journal of Sports Medicine, 
31 (2003), pp. 359-364. 


May we conclude, on the basis of these data, that in a population of similar subjects there is an 
association between age and duration of follow-up? Let a = .05. 


Refer to Exercise 13.10.3. Nozawa et al. (A-10) also calculated the Japanese Orthopaedic Association 
score for measuring back pain (JOA). The results for the 20 subjects along with the duration of 
follow-up are shown in the following table. The higher the number, the lesser the degree of pain. 


Duration of Follow-Up Duration of Follow-Up 
(Months) JOA (Months) JOA 
103 21 38 13 
68 14 36 24 
62 26 34 21 
60 24 30 22 
60 13 19 25 
54 24 19 23 
49 22 19 20 
44 23 19 21 
42 18 17 25 
41 24 16 21 


Source: Satoshi Nozawa, Katsuji Shimizu, Kei Miyamoto, and Mizuo Tanaka, 
“Repair of Pars Interarticularis Defect by Segmental Wire Fixation in Young 
Athletes with Spondylolysis,” American Journal of Sports Medicine, 31 (2003), 
pp. 359-364. 


Can we conclude from these data that in general there is a relationship between length of follow-up 
and JOA score at the time of the operation? Let a = .05. 


Butz et al. (A-11) studied the use of noninvasive positive-pressure ventilation by patients with 
amyotrophic lateral sclerosis. They evaluated the benefit of the procedure on patients” symptoms, 
quality of life, and survival. Two variables of interest are PaCO,, partial pressure of arterial carbon 
dioxide, and РАО», partial pressure of arterial oxygen. The following table shows, for 30 subjects, 
values of these variables (mm Hg) obtained from baseline arterial blood gas analyses. 


PaCO, РаО» РаСО» РаО» РаСО» РаО» 


40 101 | 54.5 80 | 34.5 86.5 
47 69 54 72 40.1 74.7 


(Continued) 
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PaCO, PaO, PaCO, PaO, PaCO, PaO, 
34 132 43 105 33 94 

42 65 44.3 113 59.9 60.4 
54 72 53.9 69.2 62.6 52.5 
48 76 41.8 66.7 54.1 76.9 
53.6 67.2 33 67 45.7 65.3 
56.9 70.9 43.1 77.5 40.6 80.3 
58 73 52.4 65.1 56.6 53.2 
45 66 37.9 NA 59 71.9 


Source: M. Butz, K. H. Wollinsky, U. Widemuth-Catrinescu, A. 
Sperfeld, S. Winter, H. H. Mehrkens, A. C. Ludolph, and H. 
Schreiber, "Longitudinal Effects of Noninvasive Positive-Pressure 
Ventilation in Patients with Amyotrophic Lateral Sclerosis," Ameri- 
can Journal of Medical Rehabilitation, 82 (2003) 597-604. 


On the basis of these data may we conclude that there is an association between РАСО» and PaO, 
values? Let a = .05. 


13.10.6 Seventeen patients with a history of congestive heart failure participated in a study to assess the 
effects of exercise on various bodily functions. During a period of exercise the following data were 
collected on the percent change in plasma norepinephrine (Y) and the percent change in oxygen 
consumption (X): 


Subject X Y Subject X Y 
1 500 525 10 50 60 
2 475 130 11 175 105 
3 390 325 12 130 148 
4 325 190 13 76 75 
5 325 90 14 200 250 
6 205 295 15 174 102 
7 200 180 16 201 151 
8 75 74 17 125 130 
9 230 420 


On the basis of these data can one conclude that there is an association between the two variables? Let 
a = .05. 


13.11 NONPARAMETRIC 
REGRESSION ANALYSIS 


When the assumptions underlying simple linear regression analysis as discussed in Chapter 
9 are not met, we may employ nonparametric procedures. In this section we present 
estimators of the slope and intercept that are easy-to-calculate alternatives to the least- 
squares estimators described in Chapter 9. 
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Theil's Slope Estimator Theil (12) proposes a method for obtaining a point 
estimate of the slope coefficient В. We assume that the data conform to the classic 
regression model 


У; = Bot Byxi +, = 1,...,п 


where the x; are known constants, Ву and В are unknown parameters, and Y; is an observed 
value of the continuous random variable Y at x;. For each value of x;, we assume a 
subpopulation of Y values, and the є; are mutually independent. The x; are all distinct (no 
ties), and we take ху < № <... < Xp. 

The data consist of п pairs of sample observations, (x1, уу), (x2, Y2); -< ., Xn; Yn) 
where the ith pair represents measurements taken on the ith unit of association. 

To obtain Theil's estimator of Ву we first form all possible sample slopes 
Sij = (y; — у) / (x; — хі), where i < j. There will be N = , C» values of Sj. The estimator 
of В, which we designate by В; is the median of S;; values. That is, 


В, = median(S;;) (13.11.1) 


The following example illustrates the calculation of Bi. 


EXAMPLE 13.11.1 


In Table 13.11.1 are the plasma testosterone (ng/ml) levels (Y) and seminal citric acid 
(mg/ml) levels in a sample of eight adult males. We wish to compute the estimate of the 
population regression slope coefficient by Theil's method. 


Solution: The N = „С = 28 ordered values of 5); are shown in Table 13.11.2. 
If weleti = 1 andj = 2, the indicators of the first and second values of 
Y and X in Table 13.11.1, we may compute 512 as follows: 


512 = (175 — 230)/(278 — 421) = —.3846 


When all the slopes are computed in a similar manner and ordered as 
in Table 13.11.2, —.3846 winds up as the tenth value in the ordered 
array. 

The median of the 5;; values is 4878. Consequently, our estimate of the 
population slope coefficient В, = .4878. 


TABLE 13.11.1 Plasma Testosterone and Seminal Citric Acid 
Levels in Adult Males 


Testosterone: 230 175 315 290 275 150 360 425 
Citric acid: 421 278 618 482 465 105 550 750 
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TABLE 13.11.2 Ordered Values of S;; 
for Example 13.11.1 


—.6618 .5037 
.1445 .5263 
.1838 .5297 
.2532 .5348 
.2614 .5637 
3216 .5927 
3250 .6801 
.3472 .8333 
.3714 .8824 
.3846 .9836 
.4118 1.0000 
.4264 1.0078 
.4315 1.0227 
.4719 1.0294 


An Estimator of the Intercept Coefficient Dietz (13) recommends two 
intercept estimators. The first, designated (д0), м is the median of the n terms у; — B jx; in 
which Bi is the Theil estimator. It is recommended when the researcher is not willing to 
assume that the error terms are symmetric about 0. If the researcher is willing to assume a 
symmetric distribution of error terms, Dietz recommends the estimator (Bo) >, м Which is 
the median of the n(n + 1)/2 pairwise averages of the y; — Вх; terms. We illustrate the 
calculation of each in the following example. 


EXAMPLE 13.11.2 


Refer to Example 13.11.1. Let us compute @| м and à» м from the data on testosterone and 
citric acid levels. 


Solution: The ordered y; — .4878x; terms are: 13.5396, 24.6362, 39.3916, 48.1730, 
54.8804, 59.1500, 91.7100, and 98.7810. The median, 51.5267, is the 
estimator (Bo), 

The 8(8 + 1) /2 = 36 ordered pairwise averages of the y; — .4878x; are 


13.5396 49.2708 75.43 
19.0879 51.5267 76.8307 
24.6362 52.6248 78.9655 
26.4656 53.6615 91.71 
30.8563 54.8804 95.2455 
32.0139 56.1603 98.781 
34.21 57.0152 

36.3448 58.1731 
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36.4046 59.15 
39.3916 61.7086 
39.7583 65.5508 
41.8931 69.0863 
43.7823 69.9415 
47.136 73.2952 
48.173 73.477 


The median of these averages, 53.1432, is the estimator 02 м. The estimating 
equation, then, is y; — 53.1432 + .4878x; if we are willing to assume that 
the distribution of error terms is symmetric about О. If we are not willing 
to make the assumption of symmetry, the estimating equation is 
у; = 51.5267 + .4878x;. и 


EXERCISES 


13.11.1 


13.11.2 


The following are the heart rates (HR: beats/minute) and oxygen consumption values (VO): 
cal/kg/24 h) for nine infants with chronic congestive heart failure: 


HR(X): 163 164 156 151 152 167 165 153 155 
УО›(У: 53.9 57.4 41.0 40.0 42.0 64.4 59.1 49.9 43.2 


Сотрще В, (бууй? апа (Ёо), м 


The following are the body weights (grams) and total surface area (cm?) of nine laboratory 
animals: 


Body weight (X): 660.2 706.0 924.0 936.0 992.1 888.9 999.4 890.3 841.2 
Surface area (Y): 781.7 888.7 1038.1 1040.0 1120.0 1071.5 1134.5 965.3 925.0 


Compute the slope estimator and two intercept estimators. 


13.12 SUMMARY 


This chapter is concerned with nonparametric statistical tests. These tests may be used 
either when the assumptions underlying the parametric tests are not realized or when the 
data to be analyzed are measured on a scale too weak for the arithmetic procedures 
necessary for the parametric tests. 

Nine nonparametric tests are described and illustrated. Except for the Kolmogorov— 
Smirnov goodness-of-fit test, each test provides a nonparametric alternative to a well- 
known parametric test. There are a number of other nonparametric tests available. The 
interested reader is referred to the many books devoted to nonparametric methods, 
including those by Gibbons (14) and Pett (15). 
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Formula 
Number Name Formula 
13.3.1 Sign test statistic ы _ 
P(k € х|п,р) = X „Сера 
k=0 
13.3.2 Large-sample _ (k+0.5) + 0.5n - 
approximation of <= 0.5 /n і <> 
the sign test 
_ (k — 0.5) — 0.5п Pgs’ 
ve OS 7: s 
13.6.1 Mann-Whitney test пп + 1) 
se T=S- 
statistic 2 
13.6.2 Large-sample B T — тп/2 
approximation of the nm(n 4- m 4- 1)/12 
Mann-Whitney test 
13.6.3 Equivalence of the Mann- рат т(т + 2n + 1) 
Whitney and Wilcoxon ees 2 
two-sample statistics 
13.7.1-13.7.2 Kolmogorov-Smirnov D = sup |F,(x) — Fr(x)| 
test statistic iS 
= max (max[|F, (х) — Fr(xi)]; ЇВ) 
—Fr(xi-1)|]} 
13.8.1 Kruskal-Wallis test 12 к R2 
statistic 5 L—3(n+1) 
ico n(n + 1) — пу 
je o 
13.8.2 Kruskal- Wallis test 1 YT 
statistic adjustment "оп 
for ties 
13.9.2 Friedman test statistic 12 š 
Rj)" - 3n(k+1 
13.10.1 Spearman rank correlation 65 d? 


test statistic 
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13.10.2 


Large-sample 
approximation of the 
Spearman rank correlation 


z—r,y/n-l 


13.10.3-13.10.4 


Correction for tied 
Observations in the 
Spearman rank correlation 


with 


EXA Dd 
"A DADA 


x (orX?) — chi-square 


13.11.1 Theil's p= median{ S;} 
estimator of В 
Symbol Key . B = Theil’s estimator of В 


* D — Kolmogorov — Smirnov test statistic 
e F(x) = distribution function of i 


* H = Friedman test ststictic 


• К = sign test statistic and the number of columns in the Friedman test 
• т = sample size of the smaller of two samples 
* n — sample size of the larger of two samples 


* p — probability of success 


e а= 1— p = probability of failure 


• R = rank 


* r, — Spearman rank correlation coefficient 


® S = sum of ranks 


e Sij = slope between point i and j 


* sup — supremum (greatest) 


* t= number of tied observations 

* T — correction for tied observations 

* xandy = data value for variables x and y 
* U — Mann- Whitney test ststistic 


* W — Wilcoxon test ststistic 


e z = normal variate 


REVIEW QUESTIONS AND EXERCISES 


Be te. Ns im 


Define nonparametric statistics. 


What is meant by the term distribution-free statistical tests? 


What are some of the advantages of using nonparametric statistical tests? 


What are some of the disadvantages of the nonparametric tests? 
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5. Describe a situation in your particular area of interest where each of the following tests could be used. 
Use real or realistic data and test an appropriate hypothesis using each test. 


(a) The sign test 

(b) The median test 

(c) The Wilcoxon test 

(d) The Mann-Whitney test 

(e) The Kolmogorov-Smirnov goodness-of-fit test 

(f) The Kruskal-Wallis one-way analysis of variance by ranks 
(g) The Friedman two-way analysis of variance by ranks 

(h) The Spearman rank correlation coefficient 

(i) Nonparametric regression analysis 


6. The following are the ranks of the ages (X) of 20 surgical patients and the dose (Y) of an analgesic 
agent required to block one spinal segment. 


Rank of Rank of Dose Rank of Rank of Dose 
Age in Requirement Age in Requirement 
Years (X) (Y) Years (X) (Y) 

1 1 11 13 

2 7 12 5 

3 2 13 11 

4 4 14 16 

5 6 15 20 

6 8 16 18 

7 3 17 19 

8 15 18 17 

9 9 19 10 
10 12 20 14 


Compute г, and test (two-sided) for significance. Let о = .05. Determine the p value for this test. 


7. Otani and Kishi (A-12) studied seven subjects with diabetic macular edema. They measured the 
foveal thickness (ит) in seven eyes pre- and post-unilateral vitrectomy surgery. The results are 
shown in the following table: 


Subject Pre-op Foveal Thickness (ита) Post-op Foveal Thickness (um) 
1 690 200 
2 840 280 
3 470 230 
4 690 200 
5 730 560 
6 500 210 
7 440 200 


Source: Data provided courtesy of Tomohiro Otani, M.D. 


Use the Wilcoxon signed-rank test to determine whether one should conclude that the surgery is 
effective in reducing foveal thickness. Let о = .05. What is the p value? 
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8. The subjects of a study by J. Jose and S. К. ЕП (A-13) were 303 healthy volunteers who self- 
assessed their own nasal flow status by indicating whether their nasal airway was (1) totally clear, 
(2) not very clear, (3) very blocked, or (4) totally blocked. Following the self-assessment, an In- 
Check meter was used to measure peak inspiratory nasal flow rate (PINFR, L/min). Data on 175 
subjects in three of the self-assessment categories are displayed in the following table. The authors 
performed a Kruskal-Wallis test to determine if these data provide sufficient evidence to indicate a 
difference in population centers of PINFR among these three response groups. Let a = .01. What 


is the test statistic value for this test? 


Peak Inspiratory Nasal Flow Rate (L/min) 


Totally Clear Not Very Clear Partially Blocked 
180 105 150 120 160 190 130 100 
150 150 110 95 200 95 110 100 
200 240 130 140 70 130 110 100 
130 120 100 135 75 240 130 105 
200 90 170 100 150 180 125 95 
120 135 80 130 80 140 100 85 
150 110 125 180 130 150 230 50 
150 155 115 155 160 130 110 105 
160 105 140 130 180 90 270 200 
150 140 140 140 90 115 180 
110 200 95 120 180 130 130 
190 170 110 290 140 210 125 
150 150 160 170 230 190 90 
120 120 90 280 220 135 210 
180 170 135 150 130 130 140 
140 200 110 185 180 210 125 
130 160 130 150 140 90 210 
230 180 170 150 140 125 120 
200 170 130 170 120 140 115 
140 160 115 210 140 160 100 
150 150 145 140 150 230 130 
170 100 130 140 190 100 130 
180 100 170 160 210 120 110 
160 180 160 120 130 120 150 
200 130 90 230 190 150 110 
90 200 110 100 220 110 90 
130 120 130 190 160 150 120 
140 145 130 90 105 130 115 
200 130 120 100 120 150 140 
220 100 130 125 140 130 130 
200 130 180 180 130 145 160 
120 160 140 200 115 160 110 
310 125 175 160 115 120 165 
160 100 185 170 100 220 120 
115 140 190 85 150 145 150 


(Continued) 
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Peak Inspiratory Nasal Flow Rate (L/min) 


Totally Clear Not Very Clear Partially Blocked 
170 185 130 150 130 150 170 
130 180 160 280 130 120 110 
220 115 160 140 170 155 120 
250 260 130 100 130 100 85 
160 160 135 140 145 140 
130 170 130 90 
130 115 120 190 
150 150 190 130 
160 130 170 


Source: Data provided courtesy of J. Jose, MS, FRCS. 


Ten subjects with bronchial asthma participated in an experiment to evaluate the relative effective- 
ness of three drugs. The following table shows the change in FEV, (forced expired volume in 1 
second) values (expressed as liters) 2 hours after drug administration: 


Drug Drug 
Subject A B С Subject A B С 


1 .00 .13 .26 6 .03 .18 .25 
2 .04 17 .23 7 .05 21 32 
3 .02 .20 .21 8 .02 .23 .38 
4 .02 27 19 9 .00 .24 .30 
5 .04 11 .36 10 12 ‚08 30 


Are these data sufficient to indicate a difference in drug effectiveness? Let a = .05. What is the p 
value for this test? 


One facet of the nursing curriculum at Wright State University requires that students use mathematics 
to perform appropriate dosage calculations. In a study by Wendy Gantt (A-14), undergraduate 
nursing students were given a standardized mathematics test to determine their mathematical 
aptitude (scale: 0-100). The students were divided into two groups: traditional college age (18— 
24 years, 26 observations) and nontraditional (25+, eight observations). Scores on the mathematics 
test appear in the following table: 


Traditional Students? Scores Nontraditional Students? Scores 
70 6 88 TI 
57 79 68 72 
85 14 88 54 
55 82 92 87 
87 45 85 85 


(Continued) 
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11. 


12. 


13. 


Traditional Students’ Scores Nontraditional Students? Scores 
84 57 56 62 

56 91 31 TI 

68 76 80 86 

94 60 


Source: Data provided courtesy of Wendy Gantt and the Wright State University 
Statistical Consulting Center. 


Do these data provide sufficient evidence to indicate а difference in population medians? Let a = .05. 
What is the p value for this test? Use both the median test and the Mann-Whitney test and compare 
the results. 


The following are ће PaCO; (mm Hg) values in 16 patients with bronchopulmonary disease: 
39, 40, 45, 48, 49, 56, 60, 75, 42, 48, 32, 37, 32, 33, 33, 36 


Use the Kolmogorov-Smirnov test to test the null hypothesis that PaCO, values in the sampled 
population are normally distributed with и = 44 and o = 12. 


The following table shows the caloric intake (cal/day/kg) and oxygen consumption VO, (ml/min/kg) 
in 10 infants: 


Calorie Calorie 
Intake (X) VOY) Intake (X) VOY) 


50 7.0 100 10.8 
70 8.0 150 12.0 
90 10.5 110 10.0 
120 11.0 75 9.5 
40 9.0 160 11.9 


Test the null hypothesis that the two variables are mutually independent against the alternative that 
they are directly related. Let о = 0.5. What is the p value for this test? 


Mary White (A-15) surveyed physicians to measure their opinions regarding the importance of ethics 
in medical practice. The measurement tool utilized a scale from 1 to 5 in which a higher value 
indicated higher opinion of the importance of ethics. The ages and scores of the study subjects are 
shown in the following table. Can one conclude on the basis of these results that age and ethics score 
are directly related? Let the probability of committing a type I error be .05. What is the p value? 


Age Ethics | Age Ethics | Age Ethics 
25 4.00 26 4.50 26 4.50 
34 4.00 29 4.75 27 5.00 
30 4.25 30 4.25 22 3.75 
31 3.50 26 4.50 22 4.25 
25 4.75 30 4.25 24 4.50 


(Continued) 
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Age Ethics 
25 3.75 
25 4.75 
29 4.50 
29 4.50 
26 3.75 
25 3.25 
29 4.50 
27 3.75 
29 4.25 
25 3:75 
25 4.50 
25 4.00 
26 4.25 
26 4.00 
24 4.00 
25 4.00 
22 3.75 
26 4.50 


Age 


25 
24 
24 
25 
25 
26 
34 
23 
26 
23 
24 
45 
23 
25 
25 
23 
23 
26 


Ethics 


3.75 
4.75 
4.00 
4.50 
4.00 
4.75 
3.25 
4.50 
3.25 
5.00 
4.25 
3:25 
3.75 
3.75 
3.75 
3.75 
4.75 
4.00 


Age | Ethics 
22 4.25 
24 3.75 
38 4.50 
22 4.50 
22 4.50 
25 4.00 
23 3.75 
22 4.25 
23 4.00 
22 4.25 
25 3.50 
26 4.25 
25 4.25 
27 4.75 
23 3.75 
22 4.00 
26 4.75 
22 4.25 
23 4.00 


REVIEW QUESTIONS AND EXERCISES 737 


Source: Data provided courtesy of Mary White, 
Ph.D. and Wright State University Statistical 
Consulting Center. 


Dominic Sprott (A-16) conducted an experiment with rabbits in which the outcome variable was the 
fatty infiltration in the shoulder mass (PFI, measured as a percent). At baseline, 15 rabbits had a 
randomly chosen shoulder muscle detached. The shoulder was then reattached. Six weeks later, five 
randomly chosen rabbits were sacrificed and the differences in the PFI between the reattached 
shoulder and the nondetached shoulder were recorded (group A). Six months later, the 10 remaining 
rabbits were sacrificed and again the differences in the PFI between the reattached shoulder and the 
nondetached shoulder were recorded (group B). 


Percent Fatty Infiltration Difference 


(Nondetached-Reattached) 


Group A Group B 
2.55 1.04 1.38 
0.9 3:20 0.75 
0.2 0.99 0.36 
—0.29 1.79 0.74 
1.11 —0.85 0.3 


Source: Data provided courtesy of Dominic Sprott, M.D. and the 
Wright State University Statistical Consulting Center. 


Can we conclude, at the .05 level of significance, that the treatments have a differential effect on PFI 
between the two shoulder muscles? What is the p value for the test? 


In each of the Exercises 15 through 29, do one or more of the following that you think are 
appropriate: 


(a) Apply one or more of the techniques discussed in this chapter. 


(b) Apply one or more of the techniques discussed in previous chapters. 
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15. 


16. 


(c) Formulate relevant hypotheses, perform the appropriate tests, and find p values. 

(d) State the statistical decisions and clinical conclusions that the results of your hypothesis tests 
justify. 

(e) Describe the population(s) to which you think your inferences are applicable. 


(f) State the assumptions necessary for the validity of your analyses. 


The purpose of a study by Damm et al. (A-17) was to investigate insulin sensitivity and insulin 
secretion in women with previous gestational diabetes (GDM). Subjects were 12 normal-weight 
glucose-tolerant women (mean age, 36.6 years; standard deviation, 4.16) with previous gestational 
diabetes and 11 controls (mean age, 35 years; standard deviation, 3.3). Among the data collected 
were the following fasting plasma insulin values (mmol/L). Use the Mann-Whitney test to determine 
if you can conclude on the basis of these data that the two populations represented differ with respect 
to average fasting plasma insulin level. 


Controls Previous GDM Controls Previous GDM 
46.25 30.00 40.00 31.25 
40.00 41.25 30.00 56.25 
31.25 56.25 51.25 61.25 
38.75 45.00 32.50 50.00 
41.25 46.25 43.75 53.75 
38.75 46.25 62.50 


Source: Data provided courtesy of Dr. Peter Damm. 


Gutin et al. (A-18) compared three measures of body composition, including dual-energy x-ray 
absorptiometry (DXA). Subjects were apparently healthy children (21 boys and 22 girls) between the 
ages of 9 and 11 years. Among the data collected were the following measurements of body- 
composition compartments by DXA. The investigators were interested in the correlation between all 
possible pairs of these variables. 


Bone Fat-Free 
Fat-Free Mineral Soft 

Percent Fat Fat Mass Mass Content Tissue 
11.35 3.8314 29.9440 1.19745 28.7465 
22.90 6.4398 21.6805 0.79250 20.8880 
12.70 4.0072 27.6290 0.95620 26.6728 
42.20 24.0329 32.9164 1.45740 31.4590 
24.85 9.4303 28.5009 1.32505 27.1758 
26.25 9.4292 26.4344 1.17412 25.2603 
23.80 8.4171 26.9938 1.11230 25.8815 
37.40 20.2313 33.8573 1.40790 32.4494 
14.00 3.9892 24.4939 0.95505 23.5388 
19.35 7.2981 30.3707 1.45545 28.9153 
29.35 11.1863 26.8933 1.17775 25.7156 


(Continued) 
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Bone Fat-Free 
Fat-Free Mineral Soft 

Percent Fat Fat Mass Mass Content Tissue 
18.05 5.8449 26.5341 1.13820 25.3959 
13.95 4.6777 28.9144 1.23730 27.6771 
32.85 13.2474 27.0849 1.17515 25.9097 
11.40 3.7912 29.5245 1.42780 28.0967 
9.60 3.2831 30.8228 1.14840 29.6744 
20.90 7.2277 27.3302 1.24890 26.0813 
44.70 25.7246 31.8461 1.51800 30.3281 
17.10 5.1219 24.8233 0.84985 23.9734 
16.50 5.0749 25.7040 1.09240 24.6116 
14.35 5.0341 30.0228 1.40080 28.6220 
15.45 4.8695 26.6403 1.07285 25.5674 
28.15 10.6715 27.2746 1.24320 26.0314 
18.35 5.3847 23.9875 0.94965 23.0379 
15.10 5.6724 31.9637 1.32300 30.6407 
37.75 25.8342 42.6004 1.88340 40.7170 
39.05 19.6950 30.7579 1.50540 29.2525 
22.25 7.2755 25.4560 0.88025 24.5757 
15.50 4.4964 24.4888 0.96500 23.5238 
14.10 4.3088 26.2401 1.17000 25.0701 
26.65 11.3263 31.2088 1.48685 29.7219 
20.25 8.0265 31.5657 1.50715 30.0586 
23.55 10.1197 32.8385 1.34090 31.4976 
46.65 24.7954 28.3651 1.22575 27.1394 
30.55 10.0462 22.8647 1.01055 21.8541 
26.80 9.5499 26.0645 1.05615 25.0083 
28.10 9.4096 24.1042 0.97540 23.1288 
24.55 14.5113 44.6181 2.17690 42.4412 
17.85 6.6987 30.8043 1.23525 29.5690 
20.90 6.5967 24.9693 0.97875 23.9905 
33.00 12.3689 25.1049 0.96725 24.1377 
44.00 26.1997 33.3471 1.42985 31.9172 
19.00 5.0785 21.6926 0.78090 20.9117 


Source: Data provided courtesy of Dr. Mark Litaker. 


The concern of a study by Crim et al. (A-19) was the potential role of flow cytometric analysis 
of bronchoalveolar lavage fluid (BALF) in diagnosing acute lung rejection. The investigators 
note that previous studies suggested an association of acute lung rejection with increases in 
CD8+ lymphocytes, and increased expression of human lymphocyte antigen (HLA)-DR 
antigen and interleukin-2 receptor (IL-2R). Subjects consisted of lung transplant (LT) recipients 
who had no histologic evidence of rejection or infection, normal human volunteers (NORM), 
healthy heart transplant (HT) recipient volunteers, and lung transplant recipients who were 
experiencing acute lung rejection (AR). Among the data collected were the following 
percentages of BALF CD8+ lymphocytes that also express IL-2R observed in the four groups 
of subjects. 
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Source: Data provided courtesy 
of Dr. Courtney Crim. 


Norm HT LT AR 
0 0 1 6 12 
2 0 0 6 0 
1 5 5 8 9 
0 4 0 16 7 
0 6 0 24 2 
2 0 5 5 6 
3 0 18 3 14 
0 4 2 22 10 
0 8 2 10 3 
1 8 8 0 0 
0 8 0 
7 3 1 
2 4 1 
5 4 0 
1 18 0 
0 4 


Ichinose et al. (A-20) studied the involvement of endogenous tachykinins in exercise-induced 
airway narrowing in patients with asthma by means of a selective neurokinin 1-receptor 
antagonist, FK-888. Nine subjects (eight male, one female) ages 18 to 43 years with at least a 
40 percent fall in the specific airway conductance participated in the study. The following are the 
oxygen consumption (ml/min) data for the subjects at rest and during exercise while under 
treatment with a placebo and FK-888: 


Placebo FK-888 


At Rest Exercise At Rest Exercise 


303 2578 255 2406 
288 2452 348 2214 
285 2768 383 3134 
280 2356 328 2536 
295 2112 321 1942 
270 2716 234 2652 
274 2614 387 2824 
9 d 198 8 Source: Data provided courtesy 


364 2538 312 2454 of Dr. Kunio Shirato. 


Transforming growth factor œ (TGFa), according to Tomiya and Fujiwara (A-21), is alleged to play а 
role in malignant progression as well as normal cell growth in an autocrine manner, and its serum 
levels have been reported to increase during this progression. The present investigators have 
developed an enzyme-linked immunosorbent assay (ELISA) for measuring serum TGFa levels 
in the diagnosis of hepatocellular carcinoma (HCC) complicating cirrhosis. In a study in which they 
evaluated the significance of serum TGFo levels for diagnostic purposes, they collected the following 
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measurements on the liver function tests, TGFo (pg/ml), and serum a-fetoprotein (AFP) (ng/ml) 
from HCC patients: 


TGFo 


32.0 
65.9 
25.0 
30.0 
22.0 
40.0 
52.0 
28.0 
11.0 
45.0 
29.0 
45.0 
21.0 
38.0 


AFP 


66 
83 
4 
214 


TGFo 


44.0 
75.0 
36.0 
65.0 
44.0 
56.0 
34.0 
300.0 
39.0 
82.0 
85.0 
24.0 
40.0 
9.0 


AFP 


23077 
371 
291 
700 

40 
9538 
19 

11 
42246 
12571 
20 

29 
310 
19 


AFP 


921 
118 
6.2 
19 
594 
10 
292 
11 
37 
35 
742 
10 
291 


Source: Data provided courtesy of Dr. Kenji Fujiwara. 


The objective of a study by Sakhaee et al. (A-22) was to ascertain body content of aluminum (A1) 
noninvasively using the increment in serum and urinary AI following the intravenous administration 
of deferoxamine (DFO) in patients with kidney stones and osteoporotic women undergoing long- 
term treatment with potassium citrate (K3Cit) or tricalcium dicitrate (СазСі), respectively. Subjects 
consisted of 10 patients with calcium nephrolithiasis and five patients with osteoporosis who were 
maintained on potassium citrate or calcium citrate for 2-8 years, respectively, plus 16 normal 
volunteers without a history of regular aluminum-containing antacid use. Among the data collected 
were the following 24-hour urinary aluminum excretion measurements (ир /Чау) before (PRE) and 


after (POST) 2-hour infusion of DFO. 


Group PRE POST Group PRE POST 
Control 41.04 135.00 Control 9.39 12.32 
Control 70.00 95.20 Control 10.72 13.42 
Control 42.60 74.00 Control 16.48 17.40 
Control 15.48 42.24 Control 10.20 14.20 
Control 26.90 104.30 Control 11.40 20.32 
Control 16.32 66.90 Control 8.16 12.80 
Control 12.80 10.68 Control 14.80 62.00 
Control 68.88 46.48 Patient 15.20 27.15 
Control 25.50 73.80 Patient 8.70 38.72 
Patient 0.00 14.16 Patient 5.52 7.84 
Patient 2.00 20.72 Patient 13.28 31.70 
Patient 4.89 15.72 Patient 3.26 17.04 
Patient 25.90 52.40 Patient 29.92 151.36 
Patient 19.35 35.70 Patient 15.00 61.38 


(Continued) 
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Group PRE 


Patient 4.88 
Patient 42.75 


POST 


70.20 
86.25 


Group 


Patient 


PRE 


36.80 


POST 


142.45 


Source: Data provided courtesy of Dr. Khashayar Sakhaee. 


The purpose of a study by Dubuis et al. (A-23) was to determine whether neuropsychological deficit 
of children with the severe form of congenital hypothyroidism can be avoided by earlier onset of 
therapy and higher doses of levothyroxine. Subjects consisted of 10 infants (ages 3 to 24 days) with 
severe and 35 infants (ages 2 to 10 days) with moderate congenital hypothyroidism. Among the data 
collected were the following measurements on plasma T4 (nmol/L) levels at screening: 


Severe Cases 


Moderate Cases 


T, 
Sex (nmol/L) 


16 
57 
40 
50 
57 


Sex 


(nmol/L) 


Ty 


20 
34 
188 
69 
162 
148 
108 
54 
96 
76 
122 
43 
40 
29 
83 
62 


Sex 


Ty 


(nmol/L) 


62 
50 
40 
116 
80 
97 
51 
84 
51 
94 
158 


47 
143 
128 
112 
111 

84 

55 


*= Missing data. 
Source: Data provided courtesy 
of Dr. Guy Van Vliet. 


Kuna et al. (A-24) conducted a study concerned with chemokines in seasonal allergic rhinitis. 
Subjects included 18 atopic individuals with seasonal allergic rhinitis caused by ragweed pollen. 
Among the data collected on these subjects were the following eosinophil cationic protein (ECP) and 
histamine measurements: 


ECP (ng/ml) Histamine (ng/ml) ECP (ng/ml) Histamine (ng/ml) 
511.0 31:2 25.3 5.6 
388.0 106.0 31.1 62.7 
14.1 37.0 325.0 138.0 
314.0 90.0 437.0 116.0 


(Continued) 
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ECP (ng/ml) 


74.1 
8.8 
144.0 
56.0 
205.0 


Histamine (ng/ml) 


29.0 
87.0 
45.0 
151.8 
86.0 


ECP (ng/ml) 


2TT.0 
602.0 

33.0 
661.0 
162.0 


Histamine (ng/ml) 


70.6 
184.0 
8.6 
264.0 
92.0 


Source: Data provided courtesy of Dr. Allen P. Kaplan. 
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The purpose of a study by Kim et al. (A-25) was to investigate the serial changes in Lp(a) lipoprotein 
levels with the loss of female sex hormones by surgical menopause and with estrogen replacement 
therapy in the same women. Subjects were 44 premenopausal women who underwent a trans- 
abdominal hysterectomy (TAH). Thirty-one of the women had a TAH and unilateral salpingo- 
oophorectomy (USO), and 13 had a TAH and bilateral salpingo-oophorectomy (BSO). The women 
ranged in age from 30 to 53 years. Subjects in the BSO group received .625 mg of conjugated equine 
estrogen daily 2 months after the operation. The following were the subjects” total cholesterol levels 
before (ТСО), 2 months after (TC2), and 4 months after (TC4) the surgical procedure and hormone 


replacement therapy. 


USO USO 

Subject TCO TC2 TC4 Subject TCO TC2 TC4 
1 202 203 196 25 134 131 135 
2 204 183 203 26 163 190 185 
3 206 199 192 27 196 183 192 
4 166 180 176 28 181 194 208 
5 150 171 154 29 160 162 181 
6 137 134 129 30 188 200 181 
7 164 168 171 31 172 188 189 
8 207 249 223 

9 126 121 140 BSO 

10 ш ш | жыш т A TA 
12 142 152 140 32 224 218 239 
13 225 193 180 33 202 196 231 
14 158 182 179 34 181 182 208 
15 184 177 182 35 191 230 208 
16 223 244 234 36 248 284 279 
17 154 178 187 37 224 228 199 
18 176 137 162 38 229 318 272 
19 205 253 288 39 147 199 194 
20 167 156 136 40 248 258 302 
21 164 176 191 41 160 218 229 
22 177 168 185 42 175 187 166 
23 140 175 167 43 262 260 247 
24 167 186 195 44 189 199 181 


Source: Data provided courtesy of Dr. Chee Jeong Kim. 
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Velthuis et al. (A-26) conducted a study to evaluate whether the combination of passively 
immobilized heparin-coating and standard heparization can reduce complement activation in patients 
undergoing cardiac surgical intervention. The investigators note that heparin-coated extracorporeal 
circuits reduce complement activation during cardiac operations, but that little in vivo information is 
available on the reduction in alternative and classic pathway activation. Complement activation 
initiates a systemic inflammatory response during and after cardiac operations and is associated with 
pathophysiologic events such as postoperative cardiac depression, pulmonary capillary leakage, and 
hemolysis. Subjects were 20 patients undergoing elective cardiopulmonary bypass (CPB) grafting 
randomly allocated to be treated with either heparin-coated extracorporeal circuits (H) or uncoated 
circuits (U). Among the data collected were the following plasma terminal complement complex 
(SC5b-9) concentrations at baseline, 10 minutes after start of CPB, at cessation of CPB, and after the 
administration of protamine sulfate: 


Patient Treatment Baseline 10 min CPB End CPB Protamine 


1 U 0.37 0.81 1.88 2.12 
2 U 0.48 0.73 3.28 3.31 
3 U 0.48 0.42 2.94 1.46 
4 H 0.37 0.44 1.28 3.82 
5 H 0.38 0.31 0.50 0.68 
6 U 0.38 0.43 1.39 5.04 
7 H 0.46 0.57 1.03 1.29 
8 H 0.32 0.35 0.75 1.10 
9 U 0.41 0.94 1.57 2.53 
10 U 0.37 0.38 2.07 1.69 
11 H 0.48 0.33 1.12 1.04 
12 H 0.39 0.39 1.69 1.62 
13 U 0.27 0.41 1.28 2.26 
14 H 0.51 0.27 1.17 1.05 
15 H 0.97 0.75 1.82 1.31 
16 U 0.53 1:57 4.49 2.15 
17 U 0.41 0.47 1.60 1.87 
18 U 0.46 0.65 1.49 1.24 
19 H 0.75 0.78 1.49 1.57 
20 H 0.64 0.52 2.11 2.44 


Source: Data provided courtesy of Dr. Henk te Velthuis. 


Heijdra et al. (A-27) state that many patients with severe chronic obstructive pulmonary disease 
(COPD) have low arterial oxygen saturation during the night. These investigators conducted a study 
to determine whether there is a causal relationship between respiratory muscle dysfunction and 
nocturnal saturation. Subjects were 20 (five females, 15 males) patients with COPD randomly 
assigned to receive either target-flow inspiratory muscle training (TF-IMT) at 60 percent of their 
maximal inspiratory mouth pressure (РІ пах) or sham TF-IMT at 10 percent of Plax. Among the data 
collected were the following endurance times (Time, s) for each subject at the beginning of training 
and 10 weeks later: 
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Time (s) TF-IMT Time (s) TF-IMT 
60% PL, 10% PL. 

Week 0 Week 10 Week 0 Week 10 
330 544 430 476 
400 590 400 320 
720 624 900 650 
249 330 420 330 
144 369 679 486 
440 789 522 369 
440 459 116 110 
289 529 450 474 
819 1099 570 700 
540 930 199 259 


Source: Data provided courtesy of Dr. Yvonne F. Heijdra. 


The three objectives of a study by Wolkin et al. (A-28) were to determine (a) the effects of chronic 
haloperidol treatment on cerebral metabolism in schizophrenic patients, (b) the relation between 
negative symptoms and haloperidol-induced regional changes in cerebral glucose utilization, and (c) 
the relation between metabolic change and clinical antipsychotic effect. Subjects were 18 male 
veterans' hospital inpatients (10 black, five white, and three Hispanic) with either acute or chronic 
decompensation of schizophrenia. Subjects ranged in age from 26 to 44 years, and their duration of 
illness ranged from 7 to 27 years. Among the data collected were the following pretreatment scores 
on the digit-symbol substitution subtest of the WAIS-R (DSY1RW) and haloperidol-induced change 
in absolute left dorsolateral prefrontal cortex (DLLA3V1) and absolute right dorsolateral prefrontal 
cortex (DLRA3V1) measured in units of umol glucose/100 g tissue/min: 


DSYIRW  DLLA3V1  DLRA3VI | DSYIRW  DLLA3V1  DLRA3VI 
47 —7.97 —17.17 18 —4.91 —9.58 
16 —8.08 —9.59 0 —1.71 .40 
31 10.15 —11.58 29 —4.62 —4.57 
34 —5.46 —2.16 17 9.48 11.31 
22 —17.12 —12.95 38 —6.59 —6.47 
70 —12.12 —13.01 64 —12.19 —13.61 
59 —9.70 —12.61 52 —15.13 —11.81 
41 —9.02 —7.48 50 —10.82 —9.45 
0 4.67 7.26 62 —4.92 —1.87 


Source: Data provided courtesy of Dr. Adam Wolkin. 


The purpose of a study by Maltais et al. (A-29) was to compare and correlate the increase in arterial 
lactic acid (La) during exercise and the oxidative capacity of the skeletal muscle in patients with 
chronic obstructive pulmonary disease (COPD) and control subjects (C). There were nine subjects in 
each group. The mean age of the patients was 62 years with a standard deviation of 5. Control 
subjects had a mean age of 54 years with a standard deviation of 3. Among the data collected were the 
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29. 


following values for the activity of phosphofructokinase (PFK), hexokinase (HK), and lactate 
dehydrogenase (LDH) for the two groups: 


PFK HK LDH 
С COPD С COPD С COPD 


106.8 49.3 2.0 2.3 241.5 124.3 
19.6 107.1 3.2 1.4 216.8 269.6 
27.3 62.9 2.5 1.0 105.6 247.8 
51.6 53.2 2.6 3.6 133.9 200.7 
73.2 105.7 2.4 1.3 336.4 540.5 
89.6 61.3 2.4 2.9 131.1 431.1 
47.7 28.2 3.5 2.2 241.4 65.3 

113.5 68.5 2.2 1.5 297.1 204.7 
46.4 40.8 2.4 1.6 156.6 137.6 


Source: Data provided courtesy of Dr. Frangois Maltais. 


Torre et al. (A-30) conducted a study to determine serum levels of nitrite in pediatric patients with 
human immunodeficiency virus type 1 (HIV-1) infection. Subjects included 10 healthy control 
children (six boys and four girls) with a mean age of 9.7 years and a standard deviation of 3.3. The 
remainder of the subjects were 21 children born to HIV-1-infected mothers. Of these, seven (three 
boys and four girls) were affected by AIDS. They had a mean age of 6 years with a standard deviation 
of 2.8. The remaining 14 children (seven boys and seven girls) became seronegative for HIV-1 during 
the first year of life. Their mean age was 3.3 years with a standard deviation of 2.3 years. Among the 
data collected were the following serum levels of nitrite (mol/L): 


Controls Seronegativized Children HIV-1-Positive Patients 
n = 10 n — 14 п= 7 
0.301 0.335 0.503 
0.167 0.986 0.268 
0.201 0.846 0.335 
0.234 1.006 0.946 
0.268 2.234 0.846 
0.268 1.006 0.268 
0.201 0.803 0.268 
0.234 0.301 
0.268 0.936 
0.301 0.268 
0.134 
0.335 
0.167 
0.234 


Source: Data provided courtesy of Dr. Donato Torre. 


Seghaye et al. (A-31) analyzed the influence of low-dose aprotinin on complement activation, 
leukocyte stimulation, cytokine production, and the acute-phase response in children undergoing 
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cardiac operations. Inclusion criterion for the study was a noncyanotic congenital cardiac defect 
requiring a relatively simple primary surgical procedure associated with a low postoperative risk. 
Among the data collected were the following measurements on interleukin-6 (IL-6) and C-reactive 
protein (CRP) obtained 4 and 24 hours postoperatively, respectively: 


IL-6 CRP IL-6 CRP IL-6 CRP 
122 32 467 53 215 50 
203 39 421 29 415 41 
458 63 421 44 66 12 

78 7 227 24 58 14 
239 62 265 31 213 9 
165 22 97 12 


Source: Data provided courtesy of Dr. Marie-Christine Seghaye. 


Exercises for Use with Large Data Sets Available on the Following Website: 
www.wiley.com/college/daniel 
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California State Assembly Bill 2071 (AB 2071) mandated that patients at methadone clinics be 
required to undergo a minimum of 50 minutes of counseling per month. Evan Kletter (A-32) 
collected data on 168 subjects who were continuously active in treatment through the Bay Area 
Addiction Research and Treatment (BAART) centers for 1 year prior to, and 2 years after AB 
207178 implementation. Prior to AB 2071, BAART center counselors spent two sessions of at 
least 15 minutes per session per month with each client. The subjects in the study were also 
identified as cocaine abusers. The observations in KLETTER are the percentages of failing a 
cocaine drug test for each of the subjects pre- and post-AB 2071. For example, a pre-value of 60 
implies that the patient failed a cocaine test 60 percent of the time prior to adoption of AB 2071. 
Dr. Kletter performed a Wilcoxon rank sum test to determine if the percentage of failed tests 
decreased significantly after the passage of AB 2071. Use the data to determine what conclusion 
he was able to reach. Report the test statistic and p value. 
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накта 14 


SURVIVAL ANALYSIS 


CHAPTER OVERVIEW 


This chapter provides an introduction to the analysis of data arising from 
studies where the time to the occurrence of an event is the outcome of interest. 
These types of studies have historically been used to monitor the survival time 
of patients who face the possibility of dying during the study, hence the use of 
the description of these techniques as "survival analysis." However, in this 
chapter we will learn techniques that can be used in the context of any outcome 
where the time to occurrence of an event is of interest. We will be employing 
techniques similarto those we have learned in previous chapters, including the 
methods for analyzing frequency data, the methods for developing linear 
models for making predictions, and topics in nonparametric statistics. 


TOPICS 


14.1 INTRODUCTION 

14.2 TIME-TO-EVENT DATA AND CENSORING 

14.8 THE KAPLAN-MEIER PROCEDURE 

14.4 COMPARING SURVIVAL CURVES 

14.5 COX REGRESSION: THE PROPORTIONAL HAZARDS MODEL 
14.6 SUMMARY 


LEARNING OUTCOMES 


After studying this chapter, the student will 


1. understand time-to-event data and how censored observations can be handled 
statistically. 


2. be able to develop and use survival curves to make conclusions. 
be able to statistically compare survival curves. 
4. understand how to develop models designed to handle time-to-event data. 


w 


14.1 INTRODUCTION 


In many studies, the outcome of interest is related to the timing of the occurrence of an 
event. In a clinical setting, one may be interested in measuring how long a chronically ill 
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patient survives after receiving a certain treatment. In another scenario, one may be 
interested in determining which of three drugs, compared to a placebo, provides symptom 
relief most rapidly. 

Imagine that a cardiac rehabilitation clinic is interested in determining if enrollment 
in a traditional health education program or enrollment in a program that provides diet and 
nutritional planning along with patient education is more effective at preventing the 
occurrence of a second myocardial infarction following a first heart attack. The study could 
begin when the first patient, following his or her first heart attack, is randomly assigned to a 
treatment program, with additional patients enrolled through time. Conversely, the study 
could begin with a cohort of subjects, each of whom has had their first heart attack, who are 
randomly assigned to a treatment program. In either case, there are potentially three 
outcomes that could occur with each patient, with the event of interest being a second heart 
attack. These are (1) the patient has a second heart attack; (2) the patient drops out of the 
study—thereby becoming a loss to follow-up—which could occur for any number of 
reasons, including death, or relocating geographically, for example; or (3) the event of 
interest does not occur to the patient during the period of study. These three mutually 
exclusive events are the foundation for survival analysis studies. 

Though the vast majority of published research using the methods of survival analysis 
is clinical in nature, it should be mentioned that there are many nonclinical uses for survival 
analysis as well. With the advent of computer-based statistical programs to help with complex 
calculations, the use of survival analysis methodologies has increased demonstrably among 
many disciplines. For example, engineers may wish to know the time it takes for a battery to 
lose its charge, a quality-control scientist at a manufacturing plant may wish to understand at 
what point machines need to be recalibrated, or an ecologist may want to estimate how long 
the average carcass remains in a study area before it is scavenged. 


14.2 TIME-TO-EVENT DATA AND CENSORING 


Measurement data for survival analysis studies utilizes the time that it takes for a well- 
defined event of interest to occur. For each subject enrolled in a study, the researcher 
records the amount of time (this could be months, days, years, or any measure of time) 
elapsing between the point at which each subject entered into the study until he or she 
experiences one of the three possible events just presented—the event occurs, the event 
does not occur, or the subject is lost to follow-up. The total amount of time between the 
initial enrollment in the study and the occurrence of one of the three outcomes is known as 
the research subject's survival time, or time-to-event. Hence, the information gathered on 
each subject is often referred to as survival data or time-to-event data. In addition to the 
survival data, covariates, such as age, gender, medication type, and diet, for example can 
also be gathered for the development of complex models. 


DEFINITION 


Survival data, or time-to-event data, are measurements of elapsed time 
between the initial enrollment in a study and the final disposition of the 
study subject. This elapsed time could be represented by the time of 
initial diagnosis or it could be represented by the point in time when one 
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FIGURE 14.2.1 Patients entering a study at different times with known (@) and censored (O) 
survival times. 


enters the study. Survival in this context simply means that an event has 
not occurred, not, necessarily, that the endpoint of interest involved an 
examination of “life”” and “death.” 


Suppose we consider patients who entered into the heart-attack study described in the 
Introduction. For illustrative purposes, suppose we examine the fate of three patients who 
were in the study (Figure 14.2.1). 

Patient A entered the study on January 1, 2002 and had a myocardial infarction on 
December 31, 2003. Patient A's survival time is therefore 24 months. Patient B entered the 
study on July 1, 2002 and moved out of state 6 months later on December 31, 2002. Patient 
B's survival time in the study is 6 months. Finally, Patient C entered the study on August 1, 
2002 and remained in the study until it ended on December 31, 2004. Patient C's survival 
time is 29 months. We, therefore, have survivorship information on these three patients that 
might be useful for analysis; however, we notice that the survival times for Patients B and C 
are not known exactly. That is, Patient B provides an example of a patient lost to follow-up, 
and patient C provides an example of a patient that completed the study without 
experiencing the event of interest. Patients B and C have survival times that are called 
censored survival times and hence these survival times are referred to as censored data. 


DEFINITION 


Censored data are represented by measurements for which we have some 
information about survival time, but the exact survival time is not 
known. 


Censored data can occur in a number of ways. In singly censored data, a fixed number of 
subjects enter into a study at the same time. Once in the study, some of the subjects will not 
experience the event. Their survival time is known to be some length of time greater than the 
length of the study. This is known as type I censoring. It could also be that for research or ethical 
reasons the study is ended after a certain proportion of the subjects experience the condition of 
interest, with the remaining proportion having not experienced the event when the study is 
ended. This is called type П censoring. It should be noted that these concepts are not related to 
the concepts of Type І error and Type П error introduced in Chapter 7. Another type of censoring 
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that may occur is known as progressively censored data in which the period of study is fixed, but 
subjects may enter the experiment at different times. Patients may then either experience or not 
experience the event of interest, with those not experiencing the event having unknown survival 
times. This is called type III censoring. Data for which exact endpoints are not known, either 
because the subject dropped out of the study, was withdrawn from the study, or survived beyond 
the termination of the study are called right-censored data because the survival times extend 
beyond the right tail of the distribution of survival times. Conversely, we could have data for 
which exact beginning points are not known. This could arise, for example, if a subject with the 
condition enters the study, but it is not known exactly when the condition developed in the 
patient. These data are known as left-censored data because their survival times are truncated 
on the left side ofthe distribution of the survival time distribution, causing the difference in time 
between diagnosis and entering into the study to be unknown. Clearly, details surrounding 
censored data are complex and require much more detailed analysis than is covered in this 
introductory text. For those interested in further reading, we suggest the books by Kleinbaum 
and Klein (1), Lee (2), and Hosmer and Lemeshow (3). 

Generally, for purposes of analysis, a dichotomous, or indicator, variable is used to 
distinguish survival times of those subjects who experience the event of interest and those 
that do not because of one of the censoring mechanisms described above. Typically this 
variable is called a status variable, with a zero indicating that an event did not occur and 
hence the survival time is censored, and a 1 indicating that the event of interest did occur. 

In studies where different treatments are being investigated, we are interested in three 
items of information for each subject: (1) Which treatment was given to the patient? (2) For 
what length of time was the patient observed? (3) Did the patient experience the event of 
interest during the study or was the survival time censored for some reason? In studies that 
are not concerned with comparing different treatment conditions, only the last two items of 
data are relevant. Additionally, we may be interested in different covariates associated with 
patients (e.g., age, gender, income level) in order to develop more complex models, and 
therefore we may develop questions based on these covariates of interest. 

With these three items of information in hand, along with any covariates of interest, 
we are able, in studies such as the myocardial infarction example mentioned in Section 
14.1, to estimate the median survival time of the group of patients who received one 
treatment compared to another. Comparison of different treatment medians allows us to 
answer the following question: Based on the information from our study, which treatment 
do we conclude delays for a longer period of time, on the average, the occurrence of a 
second heart attack? The data collected in follow-up studies such as we have described may 
also be used to answer another question of considerable interest to the clinician: What is the 
estimated probability that a patient will survive for a specified length of time? Or, Is there a 
difference in survivorship of males and females who have experienced heart attacks? For 
the myocardial infarction study, the clinician may ask: “What is the probability that a 
patient who received treatment A will survive more than 2 years?" The methods employed 
to answer these types of questions are known as survival analysis methods. 


Statistical Distribution Functions Before presenting survival analysis 
methods, it is important to consider data distributions commonly encountered in such 
analyses. Time-to-event data are distributed temporally, such that events occur either at 
some point, or within some interval, of time. These events are considered to represent a 
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random variable having some probability of occurrence at each time period for each subject 
in the study. 

We have already encountered two useful representations of probability distributions 
in Chapter 4. These were the cumulative distribution function and the probability 
distribution function. If we let the event time be represented by 7, then the cumulative 
distribution function of T is represented by F(t), such that 


F(t) = P(T <t) (14.2.1) 


That is, the cumulative distribution function represents the probability that an event 
time is less than or equal to some specified measurement time, t. As you recall from 
Chapter 4, F(t) is an increasing function that runs from a value of zero (it is assumed 
theoretically that no events have occurred at the initiation of the study), to a value of 1 (itis 
assumed theoretically that all events have occurred at the conclusion of the study). In the 
context of survival analysis, a closely related function that is more commonly used than 
F(t) is a function that runs from a value of 1 (it is assumed that all subjects at the initiation 
of the study have "survived" to that point) to a value of zero (itis assumed theoretically that 
none of the subjects have "survived" when the study ends, though some subjects may be 
censored). Conveniently, this is known as the survival distribution, S(t), and is mathemati- 
cally related to the cumulative distribution function by 


S(t) 2 1— F(t) (14.2.2) 


Both of these distributions are illustrated in Figure 14.2.2. It is the survival curve we 
generally are most interested in, and comparisons of various survival curves provide a 
statistical means to compare such things as individual survival and differences in survival 
among different treatments. 
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FIGURE 14.2.2 Illustration of the cumulative distribution function, F(t), and the survival 
distribution, S(t). 
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The probability distribution function, just as defined in Chapter 4, is represented by 
the set of probabilities that specify the possible values of a random variable. In the context 
of survival analysis, this density function represents the probability of an event occurring 
in a defined interval of time. We might ask, for example, what is the probability of 
surviving 2 months? Although fully appreciating the intricacies of this probability 
distribution requires knowledge of calculus, we can illustrate its meaning conceptually 
by remembering a concept from our discussion of the normal distribution in Chapter 4. 
When we calculated probabilities for the normal distribution, we were interested in 
calculating the area under a curve that was bounded by two values. Similarly, in survival 
analysis we are interested in calculating the probability of an event bounded by an interval 
of time, say At, and then finding our probability as the interval becomes very small, that is 
as At — 0. Hence, the probability distribution function, f(t), is defined by 


РИ«Т A 
А = (= < 2n as At — 0 (14.2.3) 


That is, the set of probabilities of events that occur in an infinitesimally small interval of 
time defines the probability function. It is also possible to find this function by examining 
what happens during a change in F(t), say AF(t), or a change in S(t), say AS(t), in a given 
interval of time. That is 


1) = = - —_ 14.2.4 
f() == = - = (14.2.4) 

Finally, a function that is often encountered in survival analysis is the hazard function, 
h(t). This function is used to define the instantaneous probability of an event occurring given 
that the subject has survived up to a given time, f. This function is defined as 


< > 
о PESTE iD AUR ED, йк уй (142.5) 


Note that this function is based on a conditional probability, wherein we are interested in 
calculating the probability of an event occurring given that the subject has already survived 
to a defined time. The condition of having already survived to a given time means that the 
probability of surviving into the future is influenced by having already survived previous 
time periods. This idea can be very important in some instances, where surviving the early 
stages of a disease may dramatically decrease the potential of an event occurring in the near 
future. As an example, consider cancer where nonrecurrence, or remission, for a period of 
5 years generally increases survivorship. This function can also be expressed in terms of 
two functions previously defined. This expression is 


A(t) = (14.2.6) 


Because the hazard function can exceed 1, it is not truly a probability, though it is based on 
the conditional probability of an event occurring. The hazard function is often defined in 
survival analysis by a known distribution such as the lognormal, exponential, or Weibull 


756 CHAPTER 14 SURVIVAL ANALYSIS 


distribution. Excellent descriptions of the various models used to represent hazard functions 
are provided by Allison (4) and Kleinbaum and Klein (1). 


14.3 THE KAPLAN-MEIER PROCEDURE 


Now let us show how we may use the data usually collected in follow-up studies of the type 
we have been discussing to estimate the probability of surviving for a specified length of 
time. The method we use was introduced by Kaplan and Meier (5) and for that reason is 
called the Kaplan—Meier procedure. Since the procedure involves the successive multipli- 
cation of individual estimated probabilities, it is sometimes referred to as the product-limit 
method of estimating survival probabilities. 

As we shall see, the calculations include the computations of proportions of subjects in a 
sample who survive for various lengths of time. We use these sample proportions as estimates of 
the probabilities of survival that we would expect to observe in the population represented by 
our sample. In mathematical terms we refer to the process as the estimation of a survivorship 
function. Frequency distributions and probability distributions may be constructed from 
Observed survival times, and these observed distributions may show evidence of following 
some theoretical distribution of known functional form. When the form of the sampled 
distribution is unknown, it is recommended that the estimation of a survivorship function be 
accomplished by means of a nonparametric technique, of which the Kaplan-Meier procedure 
is one. Nonparametric techniques are defined and discussed in detail in Chapter 13. 


Calculations for the Kaplan-Meier Procedure We let 


n — the number of subjects whose survival times are available 

ру = the proportion of subjects surviving at least the first time period 
(day, month, year, etc.) 

р» = the proportion of subjects surviving the second time period 
after having survived the first time period 

рз = the proportion of subjects surviving the third time period 
after having survived the second time period 


ру = the proportion of subjects surviving the kth time period 
after having survived the (k — 1)th time period 


We use these proportions, which we may relabel p, , б»; Рз, .. . , p, as estimates of the 
probability that a subject from the population represented by the sample will survive time 
periods 1, 2, 3, ..., k, respectively. 


For any time period, t, where 1 < t < k, we estimate the probability of surviving the 
tth time period, p;, as follows: 


. number of subjects surviving at least (t — 1) time periods who also survive the ИВ period 
pi = 


number of subjects alive at end of time period (t — 1) 


(14.3.1) 
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The probability of surviving to time f, S(t), is estimated by 


S(t) =Р X po X- X PÊ, (14.3.2) 
We illustrate the use of the Kaplan—Meier procedure with the following example. 


EXAMPLE 14.3.1 


To assess results and identify predictors of survival, Martini et al. (A-1) reviewed their total 
experience with primary malignant tumors of the sternum. They classified patients as 
having either low-grade (25 patients) or high-grade (14 patients) tumors. The event 
(status), time to event (months), and tumor grade for each patient are shown in Table 14.3.1. 
We wish to compare the 5-year survival experience of these two groups by means of the 
Kaplan—Meier procedure. 


Solution: The data arrangement and necessary calculations are shown in Table 14.3.2. 
The entries for the table are obtained as follows. 


TABLE 14.3.1 Survival Data, Subjects with Malignant Tumors of the Sternum 


Time Vital Tumor Time Vital Tumor 
Subject (Months) Status? Grade? Subject (Months) Status? Grade^ 
1 29 dod L 21 155 ned L 
2 129 ned L 22 102 dod L 
3 79 dod L 23 34 ned L 
4 138 ned L 24 109 ned L 
5 21 dod L 25 15 dod L 
6 95 ned L 26 122 ned H 
7 137 ned L 27 27 dod H 
8 6 ned L 28 6 dod H 
9 212 dod L 29 7 dod H 
10 11 dod L 30 2 dod H 
11 15 dod L 31 9 dod H 
12 337 ned L 32 17 dod H 
13 82 ned L 33 16 dod H 
14 33 dod L 34 23 dod H 
15 75 ned L 35 9 dod H 
16 109 ned L 36 12 dod H 
17 26 ned L 37 4 dod H 
18 117 ned L 38 0 dpo H 
19 8 ned L 39 3 dod H 
20 127 ned L 


?dod — dead of disease; ned — no evidence of disease; dpo — dead postoperation. 
^| — low-grade; H — high-grade. 
Source: Data provided courtesy of Dr. Nael Martini. 
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TABLE 14.3.2 Data Arrangement and Calculations for Kaplan-Meier Procedure, 
Example 14.3.1 


1 


2 


4 


6 


Time 
(Months) 


Vital Status 
0 — Censored 
1 = Dead 


Patients 
at Risk 


Patients 
Remaining 
Alive 


Survival 
Proportion 


Cumulative 
Survival 
Proportion 


Patients with Low-Grade Tumors 


23 


22 


22/23 — .956522 


.956522 


22 


20 


20/22 — .909090 


.869564 


20 


19 


19/20 — .950000 


.826086 


18 


17 


17/18 = .944444 


.780192 


17 


16 


16/17 = .941176 


.734298 


= 


14 


13 


13/14 = .928571 


.681847 


ojo 


102 


= 


11 


10 


10/11 = .909090 


.619860 


109 


109 


117 


127 


129 


137 


138 


155 
212 
337 


o;o;o;o;o;o;o;o 


1/2 = .500000 


.309930 


(Continued) 
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TABLE 14.3.2 (Continued) 


1 2 3 4 5 6 
Vital Status Patients Cumulative 
Time 0 = Censored Patients Remaining Survival Survival 
(Months) 1 = Dead at Risk Alive Proportion Proportion 
Patients with High-Grade Tumors 
0 1 14 13 13/14 = .928571 .928571 
2 1 13 12 12/13 = .923077 .857142 
3 1 12 11 11/12 = 916667 ‚785714 
4 1 11 10 10/11 - 909090 1714285 
6 1 10 9 9/10 — .900000 .642856 
7 1 9 8 8/9 — .888889 .571428 
9 1 
9 1 8 6 6/8 — .750000 .428572 
12 1 6 5 5/6 — .833333 .357143 
16 1 5 4 4/5 — .800000 .285714 
17 1 4 3 3/4 — .750000 .214286 
23 1 3 2 2/3 — .666667 .142857 
27 1 2 1 1/2 = .500000 .071428 
122 0 1 0 


. We begin by listing the observed times in order from smallest to largest in 


Column 1. 


. Column 2 contains an indicator variable that shows vital status 


(1 = died, 0 = alive or censored). 


. InColumn 3 we list the number of patients at risk for each time associated with 


the death of a patient. We need only be concerned about the times at which 
deaths occur because the survival rate does not change at censored times. 


. Column 4 contains the number of patients remaining alive just after one or 


more deaths. 


. Column 5 contains the estimated conditional probability of surviving, 


which is obtained by dividing Column 4 by Column 3. Note that although 
there were two deaths at 15 months in the low-grade group and two deaths at 
9 months in the high-grade group, we calculate only one survival proportion 
at these points. The calculations take the two deaths into account. 


. Column 6 contains the estimated cumulative probability of survival. We 


obtain the entries in this column by successive multiplication. Each entry 
after the first in Column 5 is multiplied by the cumulative product of all 
previous entries. 
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After the calculations are completed we examine Table 14.3.2 to deter- 
mine what useful information it provides. From the table we note the following 
facts, which allow us to compare the survival experience of the two groups of 
subjects: those with low-grade tumors and those with high-grade tumors: 


. Median survival time. We can determine the median survival time by locating 


the time, in months, at which the cumulative survival proportion is equal to .5. 
None of the cumulative survival proportions are exactly .5, but we see that in the 
low-grade tumor group, the probability changes from .619860 to .309930 at 212 
months; therefore, the median survival for this group is 212 months. In the high- 
grade tumor group, the cumulative proportion changes from .571428 to .428572 
at 9 months, which is the median survival for this group. 


. Five-year survival rate. We can determine the 5-year or 60-month survival 


rate for each group directly from the cumulative survival proportion at 
60 months. For the low-grade tumor group, the 5-year survival rate is 
.734298 or 73 percent; for the high-grade tumor group, the 5-year survival 
rate is .071428 or 7 percent. 


. Mean survival time. We may compute for each group the mean of the 


survival times, which we will call Т; and Ти for the low-grade and high- 
grade groups, respectively. For the low-grade tumor group we compute 
T, — 2201/25 — 88.04, and for the high-grade tumor group we compute 
Ty = 257/14 — 18.35. Since so many of the times in the low-grade group 
are censored, the true mean survival time for that group is, in reality, higher 
(perhaps, considerably so) than 88.04. The true mean survival time for the 
high-grade group is also likely higher than the computed 18.35, but with just 
one censored time we do not expect as great a difference between the 
calculated mean and the true mean. Thus, we see that we have still another 
indication that the survival experience of the low-grade tumor group is more 
favorable than the survival experience of the high-grade tumor group. 


. Average hazard rate. From the raw data of each group we may also calculate 


another descriptive statistic that can be used to compare the two survival 
experiences. This statistic is called the average hazard rate. It is a measure of 
nonsurvival potential rather than survival. A group with a higher average 
hazard rate will have a lower probability of surviving than a group with a 
lower average hazard rate. We compute the average hazard rate, designated Л 
by dividing the number of subjects who do not survive by the sum of the 
Observed survival times. For the low-grade tumor group, we compute 
hy, = 9/2201 = .004089. For the high-grade tumor group we compute 
Ян = 13/257 = .05084, We see that the average hazard rate for the high- 
grade group is higher than for the low-grade group, indicating a smaller 
chance of surviving for the high-grade group. 


The cumulative survival proportion column of Table 14.3.2 may be 
portrayed visually in a survival curve graph in which the cumulative survival 
proportions are represented by the vertical axis and the time in months by the 
horizontal axis. We note that the graph resembles stairsteps with "steps" 
occurring at the times when deaths occurred. The graph also allows us 
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Kaplan-Meier survival curve, Example 14.3.1, showing median survival times 


to represent visually the median survival time and survival rates such as the 
5-year survival rate. The graph for the cumulative survival data of 
Table 14.3.2 is shown in Figure 14.3.1. 

These observations strongly suggest that the survival experience of 
patients with low-grade tumors is far more favorable than that of patients with 


high-grade tumors. 


EXERCISES 


14.3.1 Fifty-three patients with medullary thyroid cancer (MTC) were the subjects of a study by Dottorini 
et al. (A-2), who evaluated the impact of different clinical and pathological factors and the type of 
treatment on their survival. Thirty-two of the patients were females, and the mean age of all patients 
was 46.11 years with a standard deviation of 14.04 (range 18—35 years). The following table shows 
the status of each patient at various periods of time following surgery. Calculate the survival function 
using the Kaplan—meier procedure and plot the survival curve. 


Subject Time” (Years) Status" Subject Time” (Years) Status” 
1 0 doc 28 6 alive 
2 1 mtc 29 6 alive 
3 1 mtc 30 6 alive 
4 1 mtc 31 6 alive 
5 1 mtc 32 7 mtc 
6 1 mtc 33 8 alive 
7 1 mtc 34 8 alive 
8 1 mtc 35 8 alive 
9 1 alive 36 8 alive 

10 2 mtc 37 8 alive 


(Continued) 
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Subject Time^(Years) Status" Subject Time^(Years) Status" 
11 2 mtc 38 9 alive 
12 2 mtc 39 10 alive 
13 2 alive 40 11 mtc 
14 2 alive 41 11 doc 
15 3 mtc 42 12 mtc 
16 3 mtc 43 12 doc 
17 3 alive 44 13 mtc 
18 4 mtc 45 14 alive 
19 4 alive 46 15 alive 
20 4 alive 47 16 mtc 
21 4 alive 48 16 alive 
22 > alive 49 16 alive 
23 5 alive 50 16 alive 
24 5 alive 51 17 doc 
25 5 alive 52 18 mtc 
26 6 alive 53 19 alive 
27 6 alive 


“Time is number of years after surgery. 
P doc = dead of other causes; пис = dead of medullary thyroid cancer. 
source: Data provided courtesy of Dr. Massimo E. Dottorini. 


14.3.2. Banerji et al. (A-3) followed non-insulin-dependent diabetes mellitus (NIDDM) patients from onset 
of their original hyperglycemia and the inception of their near-normoglycemic remission following 
treatment. Subjects were black men and women with a mean age of 45.4 years and a standard 
deviation of 10.4. The following table shows the relapse/remission experience of 62 subjects. 
Calculate the survival function using the Kaplan-Meier procedure and plot the survival curve. 


Total Total Total 

Duration of Duration of Duration of 

Remission Remission Remission Remission Remission Remission 
(Months) Status" (Months) Status” (Months) Status” 
3 1 8 2 26 1 

3 2 9 2 27 1 

3 1 10 1 28 2 

3 1 10 1 29 1 

3 1 11 2 31 2 

4 1 13 1 31 1 

4 1 16 1 33 2 

4 1 16 2 39 2 

5 1 17 2 41 1 

5 1 18 2 44 1 

5 1 20 1 46 1 

5 1 22 1 46 2 

5 1 22 2 48 1 

5 1 22 2 48 2 


(Continued) 
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Total Total Total 

Duration of Duration of Duration of 

Remission Remission Remission Remission Remission Remission 
(Months) Status" (Months) Status" (Months) Status” 
5 1 23 1 48 1 

6 1 24 2 49 1 

6 1 25 2. 50 1 

6 1 25 2 53 1 

7 1 26 1 70 2 

8 2 26 1 94 1 

8 1 

8 2 


“1 = yes (the patient is still in remission); 2 = no (the patient has relapsed). 
Source: Data provided Courtesy of Dr. Mary Ann Banerji. 


14.4 COMPARING SURVIVAL CURVES 


Examination of a survival curve for a single group of individuals is valuable in that it allows 
one to see characteristics that are not as easily seen by examining a set of tabulated values. 
This includes visualizing the temporal trajectory to find time periods in which there were 
dramatic changes in survival, finding time periods in which relatively little change 
occurred, or in finding the approximate median of the data distribution. The construction 
of survival curves, however, finds its greatest use when comparisons among survival 
distributions are of interest. For example, one may wish to examine differences in treatment 
in which subjects were randomly assigned, or may wish to know which medication delays 
the onset of the event of interest for the longest period of time. 

The results of comparing the survival experiences of different groups will not always 
be as dramatic as those of our previous example. For an objective comparison of the 
survival experiences of different groups, it is desirable that we have an objective technique 
for determining whether they are statistically significantly different. We know also that the 
observed results apply strictly to the samples on which the analyses are based. Of much 
greater interest is a method for determining if we may conclude that there is a difference 
between survival experiences in the populations from which the samples were drawn. In 
other words, at this point, we desire a method for testing the null hypothesis that there is no 
difference in survival experience between populations against the alternative that there is a 
difference. Such a test is provided by the log-rank test. The log-rank test is an application of 
the Mantel-Haenszel procedure discussed in Section 12.7. The extension of the procedure 
to survival data was proposed by Mantel (6). Though we may wish to compare survival 
curves of many populations, we will limit our discussion to the comparison of two groups: 
To accomplish this task, we calculate the log-rank statistic and proceed as follows: 


1. Order the survival times until death for both groups combined, omitting censored 
times. Each time constitutes a stratum as defined in Section 12.7. 


2. For each stratum or time, £j, we construct a 2 x 2 table in which the first row 
contains the number of observed deaths, the second row contains the number of 
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TABLE 14.4.1 Contingency Table for Stratum (Time) t; for Calculating the Log- 


Rank Test 

Group A Group B Total 
Number of deaths observed а; bi aj + bi 
Number of patients alive Cj d; сін d; 


Number of patients "at risk" а; + Cj bj4 d; п; = а; + bj* с; + d; 


patients alive, the first column contains data for one group, say, group A, and the 
second column contains data for the other group, say, group B. Table 14.4.1 shows 
the table for time f;. 


3. For each stratum compute the expected frequency for the upper left-hand cell of its 
table by Equation 12.7.5. 


4. For each stratum compute v; by Equation 12.7.6. 


5. Finally, compute the Mantel-Haenszel statistic (now called the log-rank statistic) by 
Equation 12.7.7. 


We illustrate the calculation of the log-rank statistic with the following example. 


EXAMPLE 14.4.1 


Let us refer again to the data on primary malignant tumors of the sternum presented in 
Example 14.3.1. Examination of the data reveals that there are 20 time periods (strata). 
For each of these a 2 x 2 table following the pattern of Table 14.4.1 must be constructed. 
The first of these tables is shown as Table 14.4.2. By Equations 12.7.5 and 12.7.6 we 
compute e; and v; as follows: 
(0 + 1)(0 + 25) 
pz = .641 
і 39 
(0 + 1)(25 + 13)(0 + 25)(1 + 13) 
392(38) 


The data for Table 14.4.2 and similar data for the other 19 time periods are shown іп 
Table 14.4.3. Using data from Table 14.4.3, we compute the log-rank statistic by Equation 
12.7.7 as follows: 


= .230 


yj — 


à: (9—17.811)? 


- — 24.724 
Хмн 3.140 


TABLE 14.4.2 Contingency Table for First Stratum (Time 
Period) for Calculating the Log-Rank Test, Example 14.4.1 


Low-Grade High-Grade Total 
Deaths 0 1 1 
Patients alive 25 13 38 


Patients at risk 25 13 39 
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TABLE 14.4.3 Intermediate Calculations for the Log-Rank Test, Example 14.4.1 


Time, t; а; Cj а; + с; b; d; b; + dj пі ej yi 
0 0 25 25 1 13 14 39 0.641 0.230 
2 0 25 25 1 12 13 38 0.658 0.225 
3 0 25 25 1 11 12 37 0.676 0.219 
4 0 25 25 1 10 11 36 0.694 0.212 
6 0 25 25 1 9 10 35 0.714 0.204 
7 0 24 24 1 8 9 33 0.727 0.198 
9 0 23 23 2 6 8 31 1.484 0.370 
11 1 22 23 0 6 6 29 0.793 0.164 
12 0 22 22 1 5 6 28 0.786 0.168 
15 2 20 22 0 5 5 27 1.630 0.290 
16 0 20 20 1 4 5 25 0.800 0.160 
17 0 20 20 1 3 4 24 0.833 0.139 
21 1 19 20 0 3 3 23 0.870 0.113 
23 0 19 19 1 2 3 22 0.864 0.118 
27 0 18 18 1 1 2 20 0.900 0.090 
29 1 17 18 0 1 1 19 0.947 0.050 
33 1 16 17 0 1 1 18 0.944 0.052 
79 1 13 14 0 1 1 15 0.933 0.062 
102 1 10 11 0 1 1 12 0.917 0.076 
212 1 1 2 0 0 0 2 1.000 0.000 
Totals 9 17.811 3.140 


Reference to Appendix Table F reveals that since 24.724 > 7.879, the p value for this test 
is < .005. We, therefore, reject the null hypothesis that the survival experience is the same 
for patients with low-grade tumors and high-grade tumors and conclude that they are 
different. 

There are alternative procedures for testing the null hypothesis that two survival 
curves are identical. They include the Breslow test (also called the generalized Wilcoxon 
test) and the Tarone-Ware test. Both tests, as well as the log-rank test, are discussed in 
Parmar and Machin (7) and Allison (4). Like the log-rank test, the Breslow test and the 
Tarone-Ware test are based on the weighted differences between actual and expected 
numbers of deaths at the observed time points. Whereas the log-rank test ranks all deaths 
equally, the Breslow and Tarone-Ware tests give more weight to early deaths. For Example 
12.8.1, SPSS computes a value of 24.93(p « .001) for the Breslow test and a value of 
25.22(p « .001) for the Tarone-Ware test. Kleinbaum (27) discusses another test called 
the Peto test. Formulas for this test are found in Parmar and Machin (7). The Peto test also 
gives more weight to the early part of the survival curve, where we find the larger numbers 
of subjects at risk. When choosing a test, then, researchers who want to give more weight to 
the earlier part of the survival curve will select either the Breslow, the Tarone-Ware, or the 
Peto test. Otherwise, the log-rank test is appropriate. 
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We have covered only the basic concepts of survival analysis in this section. The 
reader wishing to pursue the subject in more detail may consult one or more of several 
books devoted to the topic, such as those by Kleinbaum (8), Lee (9), Marubini and 
Valsecchi (10), and Parmar and Machin (7). 


Computer analysis 


Several of the available statistical software packages, such as SPSS, are capable of 
performing survival analysis and constructing supporting graphs as described in this section. 

A standard SPSS analysis of the data discussed in Examples 14.3.1 and 14.4.1 is 
shown in Figure 14.4.1. и 


Survival Functions 
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Tumor. Std. Lower Upper Std. Lower Upper 

grade Estimate Error Bound Bound Estimate Error Bound Bound 

H 18.357 8.251 2.186 34.528 9.000 1.852 5.371 12.629 

L 88.040 15.258 58.134 117.946 82.000 16.653 49.359 114.641 

Overall 63.026 11.490 40.505 85.546 27.000 7.492 12.317 41.683 


? Estimation is limited to the largest survival time if it is censored. 


Overall Comparisons 


Chi-Square df Sig. 


Log Rank (Mantel-Cox) 24.704 1 .000 
Breslow (Generalized 

Wilcoxon) 24.927 1 .000 
Tarone-Ware 25.217 1 .000 


Test of equality of survival distributions for the different levels of tumor. grade. 


FIGURE 14.4.1 SPSS output for Examples 14.3.1 and 14.4.1. 
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EXERCISES 


14.4.1 


14.4.2 


14.4.3 


If available in your library, read the article, “Impact of Obesity on Allogeneic Stem Cell Transplant 
Patients: A Matched Case-Controlled Study," by Donald R. Fleming et al. [American Journal of 
Medicine, 102 (1997), 265-268] and answer the following questions: 

(a) How was survival time determined? 


(b) Why do you think the authors used the Wilcoxon test (Breslow test) for comparing the survival 
curves? 


(c) Explain the meaning of the p values reported for Figures 1 through 4. 


(d) What specific statistical results allow the authors to arrive at their stated conclusion? 


If available in your library, read the article, “Improved Survival in Patients with Locally Advanced 
Prostate Cancer Treated with Radiotherapy and Goserelin," by Michel Bolla et al. [New England 
Journal of Medicine, 337 (1997), 295—300], and answer the following questions: 

(a) How was survival time determined? 

(b) Why do you think the authors used the log-rank test for comparing the survival curves? 

(c) Explain the meaning of the p values reported for Figures 1 and 2. 


(d) What specific statistical results allow the authors to arrive at their stated conclusion? 


Fifty subjects who completed a weight-reduction program at a fitness center were divided into two 
equal groups. Subjects in group 1 were immediately assigned to a support group that met weekly. 
Subjects in group 2 did not participate in support group activities. All subjects were followed for a 
period of 60 weeks. They reported weekly to the fitness center, where they were weighed and a 
determination was made as to whether they were within goal. Subjects were considered to be within 
goal if their weekly weight was within 5 pounds of their weight at time of completion of the weight- 
reduction program. Survival was measured from the date of completion of the weight-reduction 
program to the termination of follow-up or the point at which the subject exceeded goal. The 
following results were observed: 


Status Status 
(G — Within Goal (G — Within Goal 
Time G+ = Exceeded Goal Time G+ = Exceeded Goal 
Subject (Weeks) L = Lost to Follow-Up) | Subject (Weeks) L = Lost to Follow-Up) 
Group 1 Group 2 

1 60 G 1 20 G+ 

2 32 L 2 26 G+ 

3 60 G 3 10 G+ 

4 22 L 4 2 G+ 

5 6 G+ 5 36 G+ 

6 60 G 6 10 G+ 

7 60 G 7 20 G+ 

8 20 G4 8 18 L 

9 32 G+ 9 15 G+ 
10 60 G 10 22 G+ 
11 60 G 11 4 G+ 
12 8 G+ 12 12 G+ 


(Continued) 
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Status Status 
(G — Within Goal (G — Within Goal 
Time G-- = Exceeded Goal Time G+ = Exceeded Goal 
Subject (Weeks) L = Lost to Follow-Up) | Subject (Weeks) L = Lost to Follow-Up) 
Group 1 Group 2 
13 60 G 13 24 G+ 
14 60 G 14 6 G+ 
15 60 G 15 18 G+ 
16 14 L 16 3 G+ 
17 16 G+ 17 27 G+ 
18 24 L 18 22 G+ 
19 34 L 19 8 G+ 
20 60 G 20 10 L 
21 40 L 21 32 G+ 
22 26 L 22 7 G+ 
23 60 G 23 8 G+ 
24 60 G 24 28 G+ 
25 52 L 25 7 G+ 


Analyze these data using the methods discussed in this section. 


14.5 COX REGRESSION: THE PROPORTIONAL 
HAZARDS MODEL 


In previous chapters, we saw that regression models can be used for continuous outcome 
measures and for binary outcome measures (logistic regression). Additional regression 
techniques are available when the dependent measures may consist of a mixture of either 
time-to-event data or censored time observations. Returning to our example of a clinical 
trial of the effectiveness of two different medications to prevent a second myocardial 
infarction, we may wish to control for additional characteristics of the subjects enrolled in 
the study. For example, we would expect subjects to be different in their baseline systolic 
blood pressure measurements, family history of heart disease, weight, body mass, and 
other characteristics. Because all of these factors may influence the length of the time 
interval until a second myocardial infarction, we would like to account for these factors in 
determining the effectiveness of the medications. The regression method known as Cox 
regression (after D. R. Cox (11), who first proposed the method) or proportional hazard 
regression can be used to account for the effects of continuous and discrete covariate 
(independent variable) measurements when the dependent variable is possibly censored 
time-to-event data. 

We describe this technique by first reviewing the hazard function from Section 14.2, 
which describes the conditional probability that an event will occur at a time just larger 
than г; conditional on having survived event-free until time f;. This function is often written 
as h(t;). The regression model requires that we assume the covariates have the effect of 
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either increasing or decreasing the hazard for a particular individual compared to some 
baseline value for the function. In our clinical trial example we might measure k covariates 
on each of the subjects where there are i = 1,..., п subjects and ho(t;) is the baseline 
hazard function. We describe the regression model as 


h(t;) = ho(t;) exp (Biza + Boza + +++ + Ви) (14.5.1) 


The regression coefficients represent the change in the hazard that results 
from the risk factor, тд. that we have measured. Rearranging the above equation 
shows that the exponentiated coefficient represents the hazard ratio or the ratio of the 
conditional probabilities of an event. This is the basis for naming this method 
proportional hazards regression. You may recall that this is the same way we obtained 
the estimate of the odds ratio from the estimated coefficient when we discussed logistic 
regression in Chapter 11. 


h(t;) 
ho(ti) 


= exp (Вуса + возр +--+ + By Zi) (14.5.2) 


Estimating the covariate effects, В requires the use of a statistical software package because 
there is no straightforward single equation that will provide the estimates for this regression 
model. Computer output usually includes estimates of the regression coefficients, standard 
error estimates, hazard ratio estimates, and confidence intervals. In addition, computer output 
may also provide graphs of the hazard functions and survival functions for subjects with 
different covariate values that are useful to compare the effects of covariates on survival. 


EXAMPLE 14.5.1 


To determine whether time to relapse among drug users is related to patient age and/or 
the drug of choice, Cross (unpublished clinical data) reviewed a random sample of case 
files for high-risk drug users in an outpatient treatment clinic. The data represent the self- 
reported time that relapse occurred (or the time at which the patient was lost to follow- 
up), patient status, drug of choice, and patient age. The data are summarized in 
Table 14.5.1. 


TABLE 14.5.1 Survival Data for Patients in an Outpatient Treatment Clinic 


Status Drug Status Drug 
Time 0—Censored 1=Opiate Тіте 0= Censored 1=Opiate 
Subject (Weeks) 1 = Relapse 2=0ther Аде | Subject (Weeks) 1 = Relapse 2=0ther Age 


1 12 1 1 21 21 21 1 2 28 
2 8 1 1 18 22 41 1 2 31 
3 1 1 17 23 23 0 2 22 
4 17 1 1 17 24 15 1 2 31 
5 19 1 1 25 25 15 0 2 25 
6 12 0 1 30 26 21 1 2 19 


(Continued) 
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TABLE 14.5.1 (Continued) 


Status Drug Status Drug 
Time | 0—Censored 1= Opiate Time | 0—Censored 1= Opiate 

Subject (Weeks) 1 = Relapse 2=Other Аде | Subject (Weeks) 1 = Relapse 2=Other Age 
10 1 1 16 27 45 1 2 21 
11 1 1 23 28 37 1 2 23 
5 1 1 31 29 51 1 2 15 

2 1 1 21 30 50 1 2 29 
10 1 1 19 31 42 1 2 28 
7 0 1 18 32 21 1 2 31 
19 1 1 18 33 20 1 2 31 
11 1 1 21 34 15 1 2 26 
11 1 1 23 35 40 1 2 28 
19 1 1 15 36 39 1 2 31 
19 1 1 17 37 33 1 2 23 
24 1 1 21 38 37 1 2 23 
21 1 1 22 39 15 0 2 29 
14 1 1 17 40 52 0 2 37 


Source: Data provided courtesy of Dr. Chad L. Cross. 


For this example, we will employ the Cox Regression method algorithms provided in 
SPSS software. All references to tables and figures in the explanations below refer to 
Figure 14.5.1, which shows selected SPSS output for this example. 


1. Overall test. SPSS provides an overall test of significance much like that reported for 


logistic regression discussed in Chapter 11. In this test, the likelihood is used to 
compare a model with no parameters (the null model) and a model with the variables 
of interest included. If there is a significant difference in the likelihood function 
between the model with parameters and the null model, then the Cox regression 
model is significant, and at least one of the variables of interest is significantly related 
to the outcome variable. An examination of the output shows that the Omnibus Test 
for Model Coefficients with age and drug entered in the model is significantly 
different from the null model, with p < .001. 


. Variables in the model. Next SPSS provides a table for each of the variables entered 


into the model. Much like a standard regression model, the model parameter, its 
standard error, and a significance test are provided to test the null, H,: 8 = 0. For 
these data, type of drug was significantly predictive of time to relapse (p « .001), but 
age was not (p — .792). 


. Survival curves. Since drug of choice was found to be significantly related to the 


time of relapse, it is instructive to examine the survival curves for these data. It is 
clear from examining these curves that there is a difference in time to relapse, with 
those reporting opiate use as their primary drug of choice relapsing at a much faster 
rate than those reporting use of drugs other than opiates. 


. Hazard ratios. The hazard ratios are provided for each variable in the model. As in 


logistic regression where we calculated odds ratios, hazard ratios are found by 


Omnibus Tests of Model Coefficients 
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Overall (score) 


-2 Log Chi- 
Likelihood | square df Sig. 
167.407 25.558 2 .000 


Variables in the Equation 


95.096 CI for Exp(B) 
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3.000 24.036 
.930 1.057 
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FIGURE 14.5.1 Cox Regression survival analysis output from SPSS software for 


Example 14.5.1. 


calculating ехр(В). Examining the variable drug, where opiates were used as the 
indicator variable in SPSS, the hazard of relapse is nearly 8.5 times more likely for 
opiates compared to other drugs, controlling for the covariate of age. Although we 
can calculate the hazard ratio for age in much the same way as for drug, it is 
often useful for quantitative covariates to consider calculating the function 
100(exp(8) — 1), which provides an estimate of the percent change in the hazard 
when the covariate increases by one unit. In the present example for age, this leads to 
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100(.991 — 1) = —.9. Therefore, for each 1 year increase in age, the hazard for 
relapse decreases by an average of about .9 percent. 


5. Conclusion. Based on the results of this limited sample, we have learned that age of 
the patient, though not statistically significant, suggest that in general age may be 
somewhat protective in that risk of relapse decreases with age. We have also 
learned that those experiencing addiction to opiates are prone to relapse much 
earlier in their treatment. The results of this preliminary study may be used to 
develop further studies to determine if different, and perhaps more intensive, 
treatment programs are more successful for targeting those experience opiate 
addiction compared to other drugs. и 


Clearly Cox regression can become very complex as the number of variables 
increases. As with standard regression models discussed in early chapters, one may opt 
to use selection procedures (forward, backward, or stepwise) or examine interactions 
among variables in the models. Additionally, one may have time-dependent covariates in 
which the value of the covariate may change at each measurement time. Examples of this 
may be marriage or diagnosis with a health condition. These covariates are in contrast to 
time-constant covariates, which do not change (e.g., gender). In summary, Cox regression 
is a very useful technique for modeling survival data. For those interested in further 
reading, the texts by Kleinbaum and Klein (1), Lee (2), Hosmer and Lemeshow (3), and 
Allison (4) are highly recommended. 


EXERCISES 


14.5.1 


14.5.2 


14.5.3 


In a study examining time-to-onset of cancer after exposure to UV light in rats, age (months) was 
used as a covariate in a Cox regression model. In the model, the parameter estimate for weight was .19 
and had a p-value of .021. Provide an interpretation of this parameter estimate in terms of the hazard 
ratio. 


In the study described in Exercise 14.5.1, the researchers were also interested to know if there was a 
difference between gender in the time it took to develop cancer. For gender, the parameter estimate 
was .77 and had a p-value of 0.014. Provide an interpretation of this parameter estimate in terms of the 
hazard ratio. 


The intent of a study by Weaver et al. (A-4) was to assess whether occult lymph node metastases are 
important indicators of disease recurrence or survival in breast cancer patients. The data below 
provide some of the pertinent results of a Cox regression model for these data. 


(a) Calculate the regression parameter coefficients for each variable. 


(b) Provide an interpretation of these results using the concepts learned in this section. 


Variable Hazard Ratio (HR) 95% Clfor HR p-value 
Age (50+ vs. <50) 1.69 (1.24, 2.31) .001 
Tumor size (72 cm vs. < 2cm) 1.32 (.98, 1.76) .060 
Chemotherapy vs. no chemotherapy .88 (.68, 1.13) 31 


Radiation vs. no radiation 0.54 (.40, .73) .001 


14.6 SUMMARY 
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In this chapter an introduction to time-to-event data was provided. In particular, the 
concept of data censoring, in which exact times are not known for subjects, was 
introduced. Distributions useful in survival analysis, including the cumulative distribu- 
tion function, the survival function, and the hazard function were discussed. Calculating 
basic survival curves using the Kaplan-Meier procedure was discussed, as were methods 
for comparing survival curves using nonparametric methods. Regression concepts using 
Cox regression were provided, and detailed analysis of examples was given. The 
relationship of several methods covered in this chapter was tied to concepts learned 
earlier in the text, including linear regression, analysis of frequency data, and non- 
parametric statistics. 


SUMMARY OF FORMULAS FOR CHAPTER 14 


Formula | Name Formula 
Number 
14.2.1 Cumulative F(t) = Р(Т € 1) 
distribution function 
14.2.2 Survival function S(t) = 1— F(t) 
14.2.3 Probability P(t € T <t+Ar) 
distribution function f(t) At dE eG 
14.2.4 Relationship of AF(t) AS(t) 
probability f(t) = Woe ae 
distribution function А ; 
to the cumulative 
distribution function 
and the survival 
function 
14.2.5 Hazard function h(s) = P(t€ T «14 МТ > 1) NOUS. 
At 
14.2.7 Relationship of the кй — f(t) 
hazard function to (9 = S(t) 
the probability 
distribution function 
and the survival 
function 
14.3.1 Survival probability number of subjects surviving at least(t — 1) time period 
-— who also survive the tth period 
Pi = number of subjects alive at end of time period (t — 1) 
14.3.2 Estimated survival S(t) =p, X po X 7 


function 
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14.5.1 Hazard regression h(t;) = ho(ti) exp (Bizia + Baz +--+ + бй) 
model 
14.5.2 Proportional hazard h(t;) 
del Ec (Biza + Boza +--+ + Ви) 
Symbol • В = regression coefficient 
Кеу e Л = change 


e F(t) = cumulative distribution function 
* f(t) = probability density function 

e h(t) = hazard function 

* p — probability 

* S(f) = survival function 

* T=time of interest 

* t=time to event 

* z— risk factor in Cox regression 


ESTIONS AND EXERCISES 


лото тт вою 


10. 


11. 


Describe in words the concept of data censoring. 


Define the following: 

(a) Hazard ratio 

(b) Hazard function 

(c) Probability distribution function 
(d) Survival function 


(e) Kaplan-Meier estimate 

Explain the concepts underlying the Cox regression model. 

What is the difference between right censoring and left censoring? Provide an example of each. 
Discuss why it is often preferable to use a nonparametric test for comparisons of survival curves. 
Why is Cox regression called a “proportional hazards" model? 


If the probability distribution function at time 5 is equal to .25 and the survival function at time 5 is 
equal to .15, what is the hazard function at time 5? 


If we find that a measurement in the time interval between time 2 and 10 results in a probability 
distribution function estimate of 0.03, what is the estimated change in the cumulative distribution 
function? 


Using the data from question 8, what is the estimated change in the survival function? 


Explain why the cumulative distribution function and the survival function are mirror images of one 
another. 


The objective of a study by Lee et al. (A-5) was to improve understanding of the biologic behavior of 
gastric epithelioid stromal tumors. They studied the clinical features, histologic findings, and DNA 
ploidy of a series of the tumors to identify factors that might distinguish between benign and 
malignant variants of these tumors and have relevance for prognosis. Fifty-five patients with tumors 


12. 
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were classified on the basis of whether their tumors were high-grade malignant (grade 2), low-grade 
malignant (grade 1), or benign (grade 0). Among the data collected were the following: 


Outcome Number of Outcome Number of 
(1 = Death Days to Last (1=Death Days to Last 
Tumor from Follow-Up or Tumor from Follow-Up or 
Patient Grade Disease) Death Patient Grade Disease) Death 
1 0 0 87 8 0 0 1616 
2 0 0 TIS 9 0 0 1982 
3 0 0 881 10 0 0 2035 
4 0 0 914 11 0 0 2191 
5 0 0 1155 12 0 0 2472 
6 0 0 1162 13 0 0 2527 
7 0 0 1271 14 0 0 2782 
15 0 0 3108 36 0 0 7318 
16 0 0 3158 37 0 0 7447 
17 0 0 3609 38 0 0 9525 
18 0 0 3772 39 0 0 9938 
19 0 0 3799 40 0 0 10429 
20 0 0 3819 41 1 1 450 
21 0 0 4586 42 1 1 556 
22 0 0 4680 43 1 1 2102 
23 0 0 4989 44 1 0 2756 
24 0 0 5675 45 1 0 3496 
25 0 0 5936 46 1 1 3990 
26 0 0 5985 47 1 0 5686 
27 0 0 6175 48 1 0 6290 
28 0 0 6177 49 1 0 8490 
29 0 0 6214 50 2 1 106 
30 0 0 6225 51 2 1 169 
31 0 0 6449 32 2 1 306 
32 0 0 6669 53 2 1 348 
33 0 0 6685 54 2 1 549 
34 0 0 6873 55 2 1 973 
35 0 0 6951 


Source: Data provided courtesy of Dr. Michael B. Farnell. 


Girard et al. (A-6) conducted a study to identify prognostic factors of improved survival after 
resection of isolated pulmonary metastases (PM) from colorectal cancer. Among the data collected 
were the following regarding number of resected PM, survival, and outcome for 77 patients who 
underwent a complete resection at the first thoracic operation: 


Number of Survival Number of Survival 

Patient Resected PM (Months) Status Patient Resected PM (Months) Status 
1 1 24 Alive 8 1 15 Dead 

2 1 67 Alive 9 1 10 Dead 

3 1 42 Alive 10 1 41 Dead 

4 >1 28 Dead 11 >1 41 Dead 

5 1 37 Dead 12 1 27 Dead 

6 1 133 Alive 13 1 93 Alive 

V 1 33 Dead 14 >1 0 Dead 

15 1 60 Dead 47 1 54 Dead 


(Continued) 
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Number of Survival Number of Survival 

Patient Resected PM (Months) Status Patient Resected PM (Months) Status 
16 1 43 Dead 48 21 57 Alive 
17 >1 73 Alive 49 >1 16 Dead 
18 1 55 Alive 50 1 29 Dead 
19 1 46 Dead 51 1 14 Dead 
20 1 66 Alive 52 21 29 Dead 
21 1 10 Dead 53 >1 99 Dead 
22 >1 3 Dead 54 >1 23 Dead 
23 > 1 7 Dead 55 1 74 Alive 
24 I 129 Alive 56 1 169 Alive 
25 1 19 Alive 57 21 24 Dead 
26 >1 15 Dead 58 >1 9 Dead 
27 1 39 Alive 59 1 43 Dead 
28 1 15 Dead 60 1 3 Alive 
29 >1 30 Dead 61 >1 20 Dead 
30 1 35 Alive 62 1 2 Dead 
31 >1 18 Dead 63 >1 41 Dead 
32 1 27 Dead 64 >1 27 Dead 
33 1 121 Alive 65 1 45 Alive 
34 >1 8 Dead 66 1 26 Dead 
35 1 24 Alive 67 >1 10 Dead 
36 1 127 Alive 68 1 143 Alive 
37 1 26 Dead 69 1 16 Dead 
38 Sal 7 Dead 70 1 29 Alive 
39 >1 26 Dead 71 1 17 Dead 
40 21 17 Dead 72 21 20 Dead 
4l 1 18 Dead 73 1 92 Alive 
42 1 17 Dead 74 >1 15 Dead 
43 51 10 Dead 75 1 5 Dead 
44 >1 33 Dead 76 21 73 Alive 
45 21 42 Alive TI 1 19 Dead 
46 1 40 Alive 


Source: Data provided courtesy of Dr. Philippe Girard. 


13. Ina study by Alicikus et al. (A-7), long-term control of prostate cancer receiving radiotherapy was 
examined in patients after 10 years. The authors using Cox regression analysis to analyze these data, 
which resulted in the data summarized in the table below. For these data: 


(a) Calculate the parameter estimates for the Cox regression model. 
(b) Provide an explanation of the hazard ratios (HR) and their meaning. 


(c) For age, provide an alternative measure for the HR and provide its meaning in terms of the 
percent change in years. 


Variable Hazard Ratio (HR) 95% CIfor HR p-value 
Age 1.02 (.96, 1.08) EX 
Hormone therapy (yes vs. no) .89 (.44, 1.81) 75 
Pre-PSA, >10ng/mL vs. <10 ng/mL 241 (1.19, 4.88) .015 
Tumor classification 1.42 (1.17, 1.71) «.001 


Source: ZUMRE A. ALICIKUS, YOSHIYA YAMADA, ZHIGANG ZHANG, XIN PEI, MARGIE HUNG, MARISA KOLLMEIER, BRETT 
Cox, and MIcHaEL J. ZELEFSKy, “Ten-year Outcomes of High-Dose, Intensity-Modulated Radiotherapy for 
Localized Prostate Cancer,” Cancer, 117 (2010), 1429-1437. 
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TABLE A Random Digits 
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TABLE B Cumulative Binomial Probability Distribution 
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.9510 
.9990 
1.0000 
1.0000 
1.0000 


.02 


.9039 
.9962 
.9999 
1.0000 
1.0000 


.12 


5277 
8875 
9857 
9991 
1.0000 


1.0000 
.22 


.2887 
.6959 
.9256 
.9903 
.9995 


1.0000 
.32 


.1454 
.4875 
8095 
.9610 
.9966 


1.0000 


Р(Х <x|n, р} =}, (ee 
Х=0 


.03 


.8587 
9915 
9997 
1.0000 
1.0000 


13 


4984 
.8708 
.9821 
.9987 
1.0000 


1.0000 
.23 


.2707 
.6749 
.9164 
.9886 
.9994 


1.0000 
.33 


.1350 
4675 
.7950 
9564 
9961 


1.0000 


0 


04 


8154 
9852 
.9994 
1.0000 
1.0000 


14 


4704 
.8533 
.9780 
.9983 
.9999 


1.0000 
.24 


.2536 
.6539 
.9067 
.9866 
.9992 


1.0000 
.34 


1252 
.4478 
.7801 
.9514 
.9955 


1 


2 3 4 5 
р(х< (3 15, 40) = 9130 
п = 5 
.05 .06 
.1738 .7339 
.9774 .9681 
.9988  .9980 
1.0000 .9999 
1.0000 1.0000 
.15 .16 
4437 4182 
.8352 .8165 
.9734 .9682 
.9978 .9971 
.9999 .9999 
1.0000 1.0000 
25 .26 
.2373 .2219 
.6328 .6117 
.8965 .8857 
9844 .9819 
9990 .9988 
1.0000 1.0000 
.35 .36 
.1160 .1074 
4284 4094 
.7648 | .7491 
.9460 .9402 
.9947  .9940 
1.0000 1.0000 


1.0000 


.07 


.6957 
.9575 
.9969 
.9999 
1.0000 


.2073 
.5907 
.8743 
.9792 
.9986 


1.0000 
.37 


.0992 
.3907 
.7330 
.9340 
.9931 


1.0000 


.08 


.6591 
.9456 
.9955 
.9998 
1.0000 


.18 


3707 
17776 
.9563 
.9955 
.9998 


1.0000 
.28 


.1935 
.5697 
.8624 
.9762 
.9983 


1.0000 
.38 


.0916 
3724 
.7165 
.9274 
.9921 


1.0000 


.09 


.6240 
.9326 
.9937 
.9997 
1.0000 


19 


.3487 
.7576 
.9495 
.9945 
.9998 


1.0000 
.29 


.1804 
.5489 
.8499 
.9728 
‚9979 


1.0000 
99 


‚0845 
.3545 
.6997 
.9204 
.9910 


1.0000 


A-4 APPENDIX STATISTICAL TABLES 


TABLE B (continued) 


n — 5 (continued) 


.0656 : Я .0459 . л 5 
3199  .3033  .2871  .2714  .2562  .2415  .2272  .2135  .2002  .1875 
6651 .6475  .6295  .6114  .5931  .5747  .5561  .5375  .5187 .5000 
9051  .8967  .8879  .8786  .8688  .8585  .8478  .8365  .8247  .8125 
9884  .9869  .9853  .9835  .9815  .9794  .9771  .9745  .9718 .9688 


1.0000 1.0000 
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4970 464  .4336  .4046  .3771  .3513  .3269  .3040  .2824 .2621 
8655  .8444  .8224  .7997  .7765  .7528  .7287  .7044  .6799  .6554 
9794  .9739  .9676  .9605  .9527  .9440  .9345  .9241  .9130 .9011 


.9999  .9999 .9998  .9997  .9996  .9995  .9993  .9990 .9987  .9984 


1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 .9999 


0 
1 
2 
3 .9982  .9975  .9966  .9955 .9941  .9925  .9906  .9884  .9859 .9830 
4 
5 
6 |1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 


21 .22 .23 .24 .25 .26 27 28 .29 30 


0 22431  .2252  .2084  .1927  .1780 | .1642  .1513  .1393 .1281 | 1176 
І 6308 .6063 .5820  .5578  .5339 .5104 4872 4644 4420 4202 
2 48885 .8750  .8609  .8461  .8306  .8144  .7977  .7804  .7626 | 7443 
3 .9798 .9761 .9720 .9674  .9624  .9569  .9508  .9443  .9372 .9295 
4 .9980  .9975 .9969  .9962  .9954  .9944  .9933 .9921  .9907  .9891 
5 
6 


9999  .9999  .9999  .9998  .9998  .9997  .9996  .9995  .9994  .9993 
1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 


31 32 433 34 ED .36 :87 .38 39 40 


0 .1079  .0989  .0905  .0827  .0754  .0687  .0625  .0568  .0515 .0467 
1 3988  .3780 .3578 3381 3191  .3006  .2828  .2657  .2492 .2333 
2 .7256 .7064  .6870  .6672  .6471  .6268  .6063  .5857  .5650 .5443 
3 9213  .9125  .9031  .8931  .8826  .8714  .8596  .8473  .8343  .8208 
4 9873 .9852  .9830  .9805  .9777  .9746  .9712  .9675  .9635 .9590 
5 
6 


.9991  .9989  .9987  .9985  .9982 .9978  .9974  .9970  .9965  .9959 
1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 
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TABLE B (continued) 


n — 6 (continued) 


41 42 43 4 45 .46 47 48 49 .50 


.0422 .0381  .0343  .0308  .0277  .0248  .0222  .0198  .0176 .0156 
2181  .2035  .1895  .1762  .1636  .1515  .1401  .1293  .1190  .1094 
.5236 .5029 4823 468  .4415  .4214  .4015  .3820  .3627  .3437 
80067 7920  .7768  .7610  .7447  .7280  .7107  .6930  .6748 .6562 
.9542  .9490  .9434  .9373  .9308  .9238  .9163  .9083  .8997 .8906 


.9952  .9945  .9937  .9927  .9917  .9905 .9892  .9878  .9862 .9844 
1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 


ом Бом ~ о 


.9321 .8681  .8080  .7514  .6983  .6485  .6017  .5578  .5168 .4783 
.9980 .9921  .9829  .9706  .9556  .9382  .9187  .8974  .8745  .8503 
1.0000 .9997  .9991 .9980 .9962  .9937  .9903  .9860  .9807  .9743 
1.0000 1.0000 1.0000 4.9999 .9998 .9996  .9993  .9988  .9982  .9973 
1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000  .9999  .9999 .9998 


1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 
11 12 .13 14 AS 16 47 .18 .19 20 


4423 4087 3773 3479  .3206  .2951  .2714  .2493  .2288 .2097 
8250 7988  .7719  .7444  .7166  .6885  .6604 | .6323  .6044 .5767 
.9669  .9584  .9487  .9380  .9262  .9134  .8995  .8846  .8687  .8520 
.9961  .9946  .9928  .9906 .9879 9847  .9811  .9769  .9721  .9667 
9997  .9996  .9994 .9991 .9988  .9983  .9978  .9971  .9963  .9953 


0 

І 

2 

3 

4 

5 
* | 

0 

1 

2 

3 

4 

5 |1.0000 1.0000 1.0000 1.0000 .9999 .9999 .9999  .9998  .9997 .9996 

6 |1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 
i | 
0 
1 
2 
3 
4 
5 
6 
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TABLE B (continued) 


ом ESA 


‚3596 
‚7520 
‚9392 
9903 
.9990 


9999 
1.0000 
1.0000 


n — 7 (continued) 


.33 34 ¿39 


.3282  .2992  .2725 
7206 .6889 .6572 
.9257 .9109 .8948 
9871  .9832  .9786 
.9985 .9979 .9971 


29999  .9998 .9998 
1.0000 1.0000 1.0000 
1.0000 1.0000 1.0000 


36 


22479 
6256 
8774 
9733 
9962 


.9997 
1.0000 
1.0000 


37 


0394 
.2013 
.4866 
.7659 
.9299 


.9877 
.9991 
1.0000 


47 


‚0117 
‚0847 
.2787 
.5654 
.8197 


.9549 
‚9949 
1.0000 


.07 


.5596 
.8965 
.9853 
.9987 
.9999 


1.0000 


38 


0352 
.1863 
4641 
.7479 
.9218 


.9858 
.9989 
1.0000 


48 


.0103 
.0767 
.2607 
.5437 
.8049 


.9496 
.9941 
1.0000 
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TABLE B (continued) 


n = 8 (continued) 


21 .22 .23 .24 .25 .26 27 .28 .29 30 
0 1517 1370  .1236  .1113  .1001  .0899  .0806  .0722  .0646  .0576 
1 .4743 4462 41489  .3925 .3671  .3427  .3193  .2969  .2756  .2553 
2 11745 7514  .7276  .7033  .6785  .6535  .6282  .6027  .5772 .5518 
3 .9341  .9235  .9120  .8996  .8862  .8719  .8567  .8406  .8237  .8059 
4 .9871 .9842  .9809 9770  .9727  .9678  .9623  .9562  .9495  .9420 
5 .9984  .9979  .9973  .9966  .9958  .9948  .9936  .9922  .9906 .9887 
6 9999  .9998  .9998  .9997  .9996  .9995  .9994  .9992  .9990  .9987 
7 |1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000  .9999  .9999 
8 |1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 

31 32 33 34 35 36 37 38 39 40 
0 0514  .0457  .0406  .0360  .0319  .0281  .0248  .0218  .0192  .0168 
1 2360 .2178  .2006  .1844 161 1548  .1414 1289  .1172  .1064 
2 5264 .5013 4764 4519  .4278  .4042  .3811  .3585  .3366  .3154 
3 .7874  .7681  .7481  .7276  .7064  .6847  .6626  .6401  .6172  .5941 
4 .9339  .9250  .9154  .9051  .8939  .8820  .8693  .8557  .8414  .8263 
5 .9866  .9841  .9813  .9782  .9747  .9707  .9664 .9615  .9561  .9502 
6 .9984  .9980  .9976  .9970  .9964  .9957  .9949  .9939  .9928  .9915 
7 9999  .9999  .9999  .9998  .9998  .9997  .9996 .9996  .9995 .9993 
8 |1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 

41 42 43 44 45 46 47 48 49 50 
0 40147  .0128 | .0111  .0097  .0084  .0072  .0062  .0053  .0046 .0039 
1 .0963 .0870  .0784  .0705  .0632  .0565  .0504  .0448  .0398  .0352 
2 2948  .2750  .2560  .2376  .2901  .2034  .1875  .1724  .1581  .1445 
3 5708  .5473  .5238  .5004  .4770  .4537  .4306  .4078  .3854 .3633 
4 8105  .7938  .7765  .7584  .7396  .7202  .7001  .6795  .6584 .6367 
5 .9437  .9366  .9289  .9206  .9115  .9018 .8914  .8802  .8682  .8555 
6 .9900  .9883  .9864  .9843  .9819  .9792  .9761  .9728  .9690 .9648 
7 9992 .9990 .9988  .9986  .9983  .9980  .9976  .9972  .9967  .9961 
8 | 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 

n=9 


0 і і 1 : 4722  .4279 .3874 
1 9966  .9869  .9718  .9522 .9288  .9022 8729 8417  .8088 .7748 
2 .9999 .9994  .9980  .9955  .9916  .9862  .9791  .9702  .9595 .9470 
3 |1.0000 1.0000 .9999 .9997 .9994  .9987  .9977  .9963  .9943  .9917 
4 |1.0000 1.0000 1.0000 1.0000 1.0000 4.9999  .9998  .9997  .9995  .9991 
5 | 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 .9999 
6 1.0000 1.0000 1.0000 
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TABLE B (continued) 


n — 9 (continued) 


ll .12 ЯЗ 4 415 .16 17 .18 .19 20 


0 3504 3165  .2855  .2573  .2316  .2082  .1869  .1676  .1501  .1342 
І 7401 7049  .6696 | .6343 | .5995  .5652  .5315  .4988  .4670 | 4362 
2 .9327 .9167  .8991  .8798  .8591  .8371 | .8139  .7895  .7643  .7382 
3 9883 9842  .9791  .9731  .9661  .9580  .9488  .9385  .9270  .9144 
4 .9986  .9979  .9970  .9959  .9944  .9925  .9902  .9875  .9842 .9804 
5 
6 
7 


.9999 .9998  .9997  .9996  .9994  .9991  .9987  .9983  .9977  .9969 
1.0000 1.0000 1.0000 1.0000 1.0000 4.9999  .9999 .9998  .9998 .9997 
1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 


21 .22 23 24 .25 .26 .27 .28 .29 .30 


0 .1199  .1069 .0952  .0846  .0751  .0665  .0589 .0520  .0458 .0404 
1 4066 .3782  .3509  .3250  .3003  .2770  .2548  .2340  .2144  .1960 
2 .]115  .6842  .6566  .6287  .6007  .5727  .5448  .5171  .4898 .4628 
3 .9006 .8856  .8696  .8525  .8343 8151  .7950  .7740  .7522 | 7297 
4 .9760  .9709 .9650  .9584  .9511  .9429  .9338  .9238  .9130  .9012 
5 
6 
7 
8 


.9960  .9949 .9935  .9919  .9900 .9878  .9851  .9821  .9787 .9747 
.9996  .9994  .9992  .9990  .9987  .9983  .9978  .9972  .9965  .9957 
1.0000 1.0000 .9999  .9999  .9999  .9999  .9998  .9997  .9997  .9996 
1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 


31 32 .33 34 35 36 37 38 39 40 


0355  .0311  .0272  .0238  .0207  .0180 | .0156  .0135  .0117  .0101 
17088  .1628  .1478  .1339  .1211  .1092  .0983  .0882  .0790  .0705 
.4364 4106  .3854  .3610  .3373  .3144  .2924  .2713 2511  .2318 
7065 .6827  .6585  .6338  .6089  .5837  .5584  .5331  .5078 .4826 
.8885 .8748  .8602  .8447  .8283 8110  .7928  .7738  .7540 .7334 


0 
1 
2 
3 
4 
5 9702  .9652  .9596  .9533  .9464  .9388  .9304  .9213  .9114  .9006 
6 .9947  .9936  .9922  .9906  .9888  .9867  .9843  .9816  .9785 .9750 
7 9994  .9993 .9991  .9989  .9986  .9983  .9979  .9974  .9969 .9962 
8 |1.0000 1.0000 1.0000 9999  .9999  .9999  .9999  .9998  .9998  .9997 
9 [1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 


41 42 43 44 45 46 47 48 49 50 


0087 .0074 0064  .0054  .0046  .0039  .0033  .0028 | .0023 .0020 
0628 .0558  .0495  .0437  .0385  .0338  .0296  .0259  .0225 .0195 
.2134  .1961  .1796  .1641  .1495  .1358  .1231 1111  .1001 .0898 
4576 .4330  .4087  .3848  .3614  .3386  .3164  .2948  .2740 .2539 
.7122  .6903  .6678  .6449  .6214  .5976  .5735  .5491  .5246 .5000 


E а Е : .8342  .8183  .8015  .7839  .7654  .7461 
.9710 .9666  .9617  .9563  .9502  .9436  .9363  .9283  .9196 .9102 
9954 .9945  .9935 .9923  .9909  .9893  .9875  .9855 .9831  .9805 
.9997  .9996  .9995  .9994  .9992 .9991  .9989  .9986  .9984 .9980 

1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 


со соо Сс л ым СГ 
eo 
б© 
© 
сс 
ES] 
с 
x 
сс 
с 
95 
> 
E 
сс 
Dx] 


TABLE B (continued) 
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> м 
© COUDH &om-—o ра Qo -10U0 жою-о X| DUDO мою о 


3118 
.6972 
9116 
.9822 
.9975 


.9997 
1.0000 
1.0000 
1.0000 


¿21 


.0947 
3464 
6474 
.8609 
.9601 


.9918 
.9988 
.9999 
1.0000 
1.0000 


1 


.0245 
.1344 
.3566 
.6228 
.8321 


.9449 
.9871 
.9980 
.9998 
1.0000 


1.0000 


.02 


8171 
.9838 
9991 
1.0000 
1.0000 


1.0000 
1.0000 


.1969 
‚3443 
.8202 
.9500 
.9901 


.9986 
.9999 
1.0000 
1.0000 


.25 


22 
Ss 
ss 


0115 
0764 
2405 
.4868 
.7292 


.8928 
9695 
9941 
.9993 
1.0000 


1.0000 


07 .08 
4840 | 4344 
8483  .8121 
9717 .9599 
9964 .9942 
9997  .9994 
1.0000 1.0000 
1.0000 1.0000 
17 .18 
1552  .1374 
4730 4392 
7659  .7372 
9259  .9117 
9832 .9787 
9973 .9963 
9997 .9996 
1.0000 1.0000 
1.0000 1.0000 
27 .28 
0430 .0374 
2019  .1830 
4665 .4378 
7274  .7021 
8963 .8819 
9713 .9658 
9944  .9930 
9993 .9990 
9999  .9999 
1.0000 1.0000 
37 38 
40098 .0084 
0677 .0598 
.2206 .2017 
.4600 .4336 
-7061 .6823 
.8795 .8652 
9644 .9587 
49929 .9914 
.9991 .9989 
1.0000 |  .9999 
1.0000 1.0000 


A-10 APPENDIX STATISTICAL TABLES 


TABLE B (continued) 


m ES х - х 
Фо моол AUN A DUDO һом ~ | DUO һом -– о ES © оомо A 


41 


.0051 
0406 
.1517 
3575 
.6078 


.8166 
9374 
.9854 
.9979 
9999 


1.0000 


.01 


.8953 
.9948 
.9998 
1.0000 
1.0000 


1.0000 
1.0000 


ll 


2775 
.6548 
.8880 
.9744 
.9958 


.9995 
1.0000 
1.0000 
1.0000 


21 


0748 
‚2935 
.5842 
.8160 
.9393 


.9852 
9973 
.9997 
1.0000 
1.0000 


42 


0043 
0355 
.1372 
3335 
.5822 


.7984 
.9288 
.9828 
9975 
.9998 


1.0000 


.02 


.8007 
.9805 
.9988 
1.0000 
1.0000 


1.0000 
1.0000 


n — 10 (continued) 


43 44 
0036 .0030 
0309  .0269 
1236 1111 
3102 .2877 
5564 .5304 
7793 .7593 
9194 .9092 
9798 .9764 
9969 .9963 
9998  .9997 
1.0000 1.0000 
03 04 
7153 .6382 
9587 .9308 
9963  .9917 
9998 .9993 
1.0000 1.0000 
1.0000 1.0000 
1.0000 1.0000 
13 14 
2161  .1903 
5714 .5311 
8368 .8085 
9558  .9440 
9913  .9881 
9988 .9982 
9999 .9998 
1.0000 1.0000 
1.0000 1.0000 
23 24 
.0564 .0489 
2418 2186 
5186  .4866 
47667 .7404 
.9149 .9008 
.9769 .9717 
.9954 .9941 
.9993  .9991 
9999  .9999 


AS 


: 
: 
: 


$2 
з 
о 
о 
— 
б 
о 
ce 
© 


29 


0422 
.1971 
4552 
.7133 
.8854 


.9657 
.9924 
9988 
9999 


à 


.0364 
.1773 
4247 
.6854 
.8687 


.9588 
.9905 
.9984 
.9998 


1.0000 1.0000 1.0000 1.0000 


47 


.0017 
:0173 
:0791 
.2255 
4526 


‚6943 
.8729 
.9634 
.9935 
.9995 


1.0000 


© 
e 
e 
e 


.0314 
.1590 
3951 
.6570 
.8507 


.9510 
.9881 
-9979 
.9998 


.0270 
.1423 
.3665 
.6281 
.8315 


.9423 
.9854 
.9973 
9997 


e 
о 
© 
© 


0231 
.1270 
.3390 
.5989 
.8112 


.9326 
.9821 
.9966 
9996 


1.0000 1.0000 1.0000 


© 
о 
о 
о 
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TABLE B (continued) 


n — 11 (continued) 


3) 36 37 38 39 40 


VA 
бо 
bo 
[e] 
бо 
©з 
бо 
> 


со со зс л шым oO 
о 
e 
о 
со 
сс 
о 
с 
о 
со 
oo 
№ 
со 
a 
I 
г 
со 
сл 
> 
eo 
o) 
оо 
© 
со 
сл 
© 
ч 
о 
сл 
ч 
ыз 
- 
сл 
E 
сл 
> 
a 


—© шомоо FON о 
со 
со 
— 
о 
оо 
è 
со 
сл 
о 
N 

Е аа 
м 
оо 
кә 
co 
N 
с 
De] 
œ 
Ф 
со 
ч 
со 
о 
© 
~ 
с 
со 
со 
ч 
- 
ч 
- 
- 
N 
o 
с 


7 : 6938  .6127  .5404 .4759 . : 3225 
.9938 .9769 .9514  .9191  .8816  .8405  .7967  .7513  .7052  .6590 
9998 .9985  .9952  .9893  .9804  .9684  .9532  .9348  .9134 .8891 

1.0000 .9999  .9997  .9990  .9978  .9957  .9925  .9880  .9820 .9744 

1.0000 1.0000 1.0000 4.9999  .9998  .9996  .9991  .9984  .9973 .9957 


1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 .9999  .9998  .9997 .9995 
1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000  .9999 
1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 


чом AOON- 
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TABLE B (continued) 


n — 12 (continued) 


ll 212 .13 14 .15 .16 17 .18 19 
0 
1 
2 
3 
4 
5 
6 
7 
8 
9 

x 


24700 2157  .1880  .1637  .1422  .1234  .1069  .0924  .0798 
.6133 .5686 .5252  .4834  .4435  .4055  .3696  .3359 .3043 
48623  .8333  .8023  .7697  .7358  .7010  .6656  .6298 .5940 
9649 .9536  .9403  .9250  .9078  .8886  .8676  .8448 .8205 
9935 .9905  .9867  .9819  .9761  .9690  .9607  .9511 .9400 


.9991 .9986  .9978  .9967  .9954  .9935  .9912  .9884 .9849 
.9999  .9998  .9997  .9996  .9993  .9990  .9985  .9979  .9971 
1.0000 1.0000 1.0000 1.0000 .9999  .9999  .9998  .9997  .9996 
1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 
1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 


N 21 .22 .23 .24 25 .26 27 .28 29 


0591 .0507  .0434  .0371  .0317  .0270  .0229  .0194  .0164 
2476 .2224  .1991  .1778  .1584  .1406  .1245  .1100 .0968 
.9232  .4886  .4550  .4222  .3907  .3603  .3313  .3037 2775 
7674  .7390  .7096  .6795  .6488  .6176  .5863  .5548  .5235 
9134  .8979  .8808  .8623 8424 8210  .7984  .7746 .7496 


0 
1 
2 
3 
4 
5 | 9755 .9696  .9626  .9547  .9456  .9354  .9240  .9113  .8974 
6 | 9948  .9932 .9911  .9887  .9857  .9822  .9781  .9733  .9678 
7 | .9992 .9989 .9984  .9979  .9972  .9964  .9953  .9940  .9924 
8 | .9999 .9999  .9998  .9997  .9996  .9995  .9993  .9990  .9987 
9 |1.0000 1.0000 1.0000 1.0000 1.0000 4.9999  .9999  .9999  .9998 


10 |1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 
32 33 34 35 .36 37 38 39 


х 
о 
бо 


0116  .0098  .0082  .0068  .0057  .0047  .0039 .0032  .0027 
.0744 0650 | .0565  .0491  .0424  .0366  .0315  .0270 .0230 
.2296  .2078  .1876  .1687  .1513  .1352  .1205  .1069 .0946 
4619 4319  .4027 3742  .3467 .3201  .2947  .2704  .2472 
.6968 .6692  .6410  .6124  .5833  .5541  .5249  .4957 .4668 


8657 .8479  .8289  .8087  .7873  .7648  .7412  .7167  .6913 
E .9460  .9368  .9266  .9154  .9030  .8894  .8747  .8589 
.9882  .9856  .9824  .9787  .9745  .9696  .9641  .9578  .9507 
9978  .9972  .9964  .9955  .9944  .9930  .9915  .9896 .9873 
.9997 .9996 .9995  .9993  .9992  .9989  .9986  .9982  .9978 


1.0000 1.0000 1.0000 .9999  .9999  .9999  .9999  .9998  .9998 
1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 


— © оомо ом ~ 
wo 
сл 
> 
ко 


— = 
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TABLE B (continued) 


n = 12 (continued) 


шо моол RO NO 


01 02 03 04 .05 .06 07 .08 .09 .10 


0 | .8775  .7690 6730  .5882 .5133  .4474  .3893  .3383  .2935 .2542 
1 | .9928 .9730  .9436  .9068  .8646  .8186  .7702  .7206  .6707 .6213 
2 | 9997  .9980  .9938  .9865  .9755  .9608  .9422  .9201  .8946  .8661 
3 |1.0000 .9999  .9995  .9986  .9969  .9940  .9897  .9837  .9758 .9658 
4 |1.0000 1.0000 1.0000 .9999  .9997  .9993 .9987  .9976  .9959  .9935 
5 
6 
7 


1.0000 1.0000 1.0000 1.0000 1.0000  .9999  .9999  .9997  .9995  .9991 
1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000  .9999 .9999 
1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 


Н 12 13 14 .15 .16 27 .18 .19 20 


22198 .1898 | .1636 .1408  .1209  .1037  .0887  .0758  .0646 .0550 
5730 .5262 4814 4386  .3983  .3604  .3249  .2920  .2616 .2336 
48349 8015  .7663  .7296  .6920  .6537  .6152  .5769  .5389 .5017 
.9536 .9391  .9224  .9033  .8820  .8586  .8333 .8061  .7774  .7473 
.9903  .9861  .9807  .9740  .9658  .9562  .9449  .9319  .9173  .9009 


; .9976  .9964  .9947  .9925  .9896  .9861  .9817  .9763  .9700 

.9998  .9997  .9995  .9992 .9987 .9981  .9973  .9962  .9948 .9930 
1.0000 1.0000 .9999  .9999 .9998  .9997  .9996  .9994  .9991  .9988 
1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000  .9999  .9999  .9998 
1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 


хоче A) 
Ф 
Ф 
со 
© 
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TABLE B (continued) 


n — 13 (continued) 


21 22 :23 24 .25 .26 27 28 29 30 


0467 .0396  .0334  .0282  .0238  .0200  .0167  .0140  .0117 .0097 
2080  .1846 .1633  .1441  .1267 1111  .0971  .0846  .0735 .0637 
4655 4301 .3961  .3636  .3326  .3032  .2755  .2495  .2251  .2025 
7161  .6839  .6511  .6178  .5843  .5507  .5174  .4845  .4522  .4206 
8827  .8629 | .8415  .8184  .7940  .7681 .7411  .7130  .6840 | .6543 


0 
1 
2 
3 
4 
5 | .9625 .9538  .9438  .9325  .9198  .9056  .8901  .8730  .8545 .8346 
6 | .9907 .9880  .9846  .9805  .9757  .9701  .9635  .9560  .9473  .9376 
7 | 9983  .9976 .9968  .9957  .9944  .9927  .9907  .9882  .9853 .9818 
8 | 9998  .9996  .9995  .9993  .9990 .9987  .9982  .9976  .9969  .9960 
9 |1.0000 1.0000  .9999  .9999  .9999  .9998  .9997  .9996  .9995  .9993 
0 
1 


1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000  .9999 .9999 
1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 


31 32 33 34 .35 .36 .37 .38 .39 40 


20080  .0066  .0055  .0045  .0037  .0030  .0025  .0020  .0016 .0013 
.0550 | .0473  .0406  .0347  .0296  .0251  .0213  .0179  .0151 .0126 
.1815  .1621  .1443  .1280  .1132  .0997  .0875  .0765  .0667  .0579 
.3899  .3602  .3317  .3043  .2783  .2536  .2302  .2083  .1877  .1686 
.6240 .5933  .5624  .5314  .5005  .4699  .4397  .4101  .3812 .3530 


0 
1 
2 
3 
4 
5 | .8133 7907  .7669  .7419  .7159  .6889  .6612  .6327  .6038  .5744 
6 | 9267 .9146  .9012 .8865  .8705  .8532  .8346  .8147  .7935  .7712 
7 | 9777 .9729  .9674  .9610  .9538  .9456  .9365  .9262  .9149 .9023 
8 | 9948 9935  .9918  .9898  .9874  .9846  .9813  .9775  .9730 .9679 
9 | 9991 .9988 .9985  .9980  .9975  .9968  .9960  .9949  .9937 .9922 


10 | .9999  .9999 .9998  .9997  .9997  .9995  .9994  .9992  .9990 .9987 
11 |1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 .9999  .9999  .9999 .9999 
12 |1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 


41 42 43 44 45 46 47 .48 .49 .50 


0 | .0010 .0008  .0007 .0005  .0004  .0003  .0003  .0002  .0002 .0001 
1 0105 .0088 .0072  .0060  .0049  .0040  .0033 .0026  .0021  .0017 
2 | 0501  .0431 .0370  .0316  .0269  .0228  .0192  .0162  .0135  .0112 
3 | .1508 .1344  .1193  .1055  .0929  .0815  .0712  .0619  .0536  .0461 
4 | .3258  .2997  .2746  .2507  .2279  .2065  .1863  .1674  .1498  .1334 
5 
6 
7 
8 


5448 .5151 4854  .4559  .4268  .3981  .3701  .3427  .3162 .2905 
.7476 7230  .6975  .6710  .6437  .6158  .5873  .5585  .5293 .5000 
48886 .8736  .8574  .8400  .8212  .8012  .7800  .7576  .7341 .7095 
9621  .9554  .9480  .9395  .9302  .9197  .9082  .8955  .8817 .8666 
9904  .9883  .9859  .9830  .9797  .9758  .9713  .9662  .9604 .9539 


10 | 9983  .9979 .9973  .9967  .9959  .9949  .9937  .9923  .9907 .9888 
11 | .9998 .9998  .9997  .9996  .9995  .9993 .9991  .9989  .9986 .9983 
12 |1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 .9999  .9999  .9999  .9999 
13 |1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 
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TABLE B (continued) 


ooo 
CO C C9 
sss 
МЕРОСНИ 
288 
288 
—— 
sss 
288 
MN 
ЕЕЕ 
ooo 
AT 
ooo 
ooo 
Sex 
338 
о о 
225 
== 
оо о 
оо о 
sss 
TTE 
оо о 
о о 
558 
vend 

sge 
3388 
к 

о о о 
8358 
© сос 


1956 1670 .1423  .1211  .1028  .0871  .0736  .0621  .0523 .0440 
5342 4859  .4401  .3969  .3567  .3193  .2848  .2531  .2242  .1979 
8061 .7685  .7292  .6889  .6479  .6068  .5659  .5256  .4862 .4481 
9406 .9226 .9021  .8790  .8535  .8258  .7962  .7649  .7321 .6982 
9863 .9804  .9731  .9641  .9533  .9406  .9259  .9093  .8907  .8702 


0 
1 
2 
3 
4 
5 | 9976 .9962  .9943  .9918  .9885  .9843  .9791  .9727  .9651  .9561 
6 | 9997  .9994 .9991  .9985  .9978  .9968  .9954  .9936  .9913 .9884 
7 | 1.0000 .9999  .9999  .9998  .9997  .9995  .9992  .9988  .9983 .9976 
8 |1.0000 1.0000 1.0000 1.0000 1.0000 .9999  .9999  .9998  .9997  .9996 
9 |1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 


21 .22 .23 .24 .25 .26 .27 .28 .29 .30 


.0369 .0309  .0258  .0214  .0178  .0148  .0122  .0101  .0083 .0068 
.1741  .1527  .1335  .1163  .1010 .0874  .0754  .0648  .0556 .0475 
4113 3761  .3426  .3109  .2811  .2533  .2273  .2033  .1812  .1608 
6634 .6281  .5924  .5568  .5213  .4864  .4521  .4187  .3863  .3552 
8477 8235  .7977  .7703  .7415  .7116  .6807  .6490  .6168 .5842 


0 
І 
2 
3 
4 
5 | 9457  .9338  .9203  .9051  .8883  .8699  .8498  .8282  .8051  .7805 
6 | .9848  .9804  .9752  .9690  .9617  .9533  .9437  .9327  .9204 .9067 
7 | 9967  .9955  .9940  .9921  .9897  .9868  .9833  .9792  .9743 .9685 
8 | .9994 .9992 9989 .9984  .9978 .9971  .9962  .9950  .9935 .9917 
9 | 9999  .9999 .9998 .9998  .9997  .9995  .9993  .9991  .9988 .9983 
0 
1 


1.0000 1.0000 1.0000 1.0000 1.0000 .9999 .9999  .9999  .9998  .9998 
1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 


— 


TABLE B (continued) 


td 
[^ 
= 


х —— ке нні 

хоче воює о N—O OMINDS PWNS 
ES 
= 


ом Бомо 
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32 


0045 
0343 
.1254 
.2968 
5187 


‚7276 
.8750 
.9542 
.9869 
.9971 


9995 
.9999 
1.0000 
1.0000 


42 


0005 
0054 
0287 
.0961 
2303 


4246 
.6357 
.8104 
.9211 
.9745 


.9939 
.9990 
.9999 
1.0000 
1.0000 


.9647 
.9970 
.9998 
1.0000 


1.0000 
1.0000 


n = 14 (continued) 


.33 34 
40037  .0030 
0290 .0244 
1101 .0963 
.2699 .2444 
4862 4542 
.6994 .6703 
8569 .8374 
9455 9357 
29837 .9800 
9963 .9952 
.9994 .9992 
9999 .9999 
1.0000 1.0000 
1.0000 1.0000 
43 44 
.0004 .0003 
.0044 .0036 
40242 .0203 
0839 .0730 
.2078 .1868 
3948 3656 
-6063 .5764 
47887 7656 
49090 .8957 
9696 .9639 
.9924 .9907 
.9987 .9983 
9999 .9998 
1.0000 1.0000 
1.0000 1.0000 


.8809 
.9906 .9797 
.9992 .9976 
9999 .9998 
1.0000 1.0000 
1.0000 


35 


.36 


.7738 
.9429 
.9896 
.9986 


.9999 
1.0000 


37 


0016 
.0143 
.0630 
.1774 
.3622 


.5792 
.7704 
.8988 
.9647 
.9905 


.9981 
.9997 
1.0000 
1.0000 


47 


.0001 
.0019 
0117 
0468 
.1322 


.2837 
.4852 
.6895 
.8480 
9417 


.9832 
.9966 
9996 
1.0000 
1.0000 


‚7168 
9171 
9825 
.9972 


.9997 
1.0000 


38 


0012 
0119 
‚0543 
.1582 
.3334 


.5481 
17455 
8838 
9580 
.9883 


.9976 
.9997 
1.0000 
1.0000 


.48 


.0001 
.0015 
.0097 
.0399 
.1167 


.2585 
.4549 
.6620 
.8293 
.9323 


.9798 
.9958 
‚9994 
1.0000 
1.0000 


.2863 
.6597 
.8870 
9727 
9950 


9993 
.9999 
1.0000 


.2430 
.6035 
.8531 
9601 
.9918 


.9987 
.9998 
1.0000 


.2059 
5490 
8159 
9444 
9873 


29978 
29997 
1.0000 
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TABLE B (continued) 


n — 15 (continued) 


ЧЕ 12 .13 14 .15 .16 .17 .18 .19 20 
0 
1 
2 
3 
4 
5 
6 
T 
8 
9 


.1741 .1470 1238  .1041  .0874  .0731  .0611  .0510  .0424 .0352 
.4969  .4476  .4013  .3583  .3186  .2821  .2489  .2187  .1915  .1671 
.7762 7344 86916  .6480  .6042  .5608  .5181  .4766  .4365 .3980 
.9258 .9041  .8796  .8524  .8227  .7908  .7571  .7218  .6854 .6482 
9813 .9735  .9639  .9522  .9383  .9222  .9039  .8833  .8606 .8358 


9965 9943  .9916  .9879  .9832  .9773  .9700  .9613  .9510  .9389 
9994 9990 .9985  .9976 .9964  .9948  .9926  .9898  .9863  .9819 
.9999  .9999  .9998  .9996  .9994  .9990  .9986  .9979  .9970 .9958 
1.0000 1.0000 1.0000 1.0000  .9999  .9999  .9998  .9997  .9995  .9992 
1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000  .9999  .9999 


10 |1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 
21 22 .23 .24 .25 .26 .27 .28 .29 .30 


0291 .0241  .0198 .0163  .0134  .0109  .0089 .0072  .0059  .0047 
.1453 1259  .1087  .0935  .0802  .0685  .0583  .0495  .0419 .0353 
43615 3269  .2945  .2642  .2361  .2101  .1863 | .1645  .1447  .1268 
6105  .5726  .5350  .4978  .4613  .4258  .3914  .3584  .3268 .2969 
.8090 — .7805  .7505  .7190  .6865  .6531  .6190  .5846  .5500  .5155 


0 
1 
2 
3 
4 
5 | .9252  .9095  .8921  .8728 8516  .8287  .8042  .7780  .7505  .7216 
6 | .9766  .9702  .9626  .9537  .9434  .9316  .9183  .9035  .8870 .8689 
7 | 9942  .9922  .9896  .9865  .9827  .9781  .9726  .9662  .9587  .9500 
8 | .9989 .9984  .9977  .9969 .9958  .9944  .9927  .9906  .9879  .9848 
9 | .9998 .9997  .9996  .9994  .9992  .9989  .9985  .9979  .9972  .9963 


10 |1.0000 1.0000 .9999 .9999  .9999  .9998  .9998  .9997  .9995  .9993 
11 |1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000  .9999 .9999 
12 |1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 


31 32 33 34 35 .36 37 38 39 40 


0038 .0031 | .0025  .0020  .0016 .0012  .0010  .0008  .0006 .0005 
0296 .0248  .0206  .0171  .0142  .0117  .0096  .0078  .0064  .0052 
1107  .0962  .0833  .0719  .0617  .0528  .0450  .0382  .0322  .0271 
.2686 2420  .2171  .1940  .1727  .1531  .1351  .1187  .1039  .0905 
443  .4477  .4148 .3829 .3519  .3222  .2938  .2668  .2413  .2173 


0 
1 
2 
3 
4 
5 | 6916  .6607  .6291 .5968 .5643  .5316  .4989  .4665  .4346 .4032 
6 | .8491 8278 8049  .7806 .7548  .7278  .6997  .6705  .6405 .6098 
7 | 9401  .9289  .9163  .9023  .8868  .8698  .8513 .8313 .8098  .7869 
8 | .9810 .9764  .9711  .9649 .9578  .9496  .9403  .9298  .9180 .9050 
9 | .9952  .9938  .9921  .9901  .9876  .9846  .9810  .9768  .9719  .9662 


10 | 9991 .9988  .9984  .9978  .9972  .9963  .9953 .9941  .9925 .9907 
11 | .9999 .9998  .9997  .9996  .9995  .9994  .9991  .9989  .9985 .9981 
12 |1.0000 1.0000 1.0000 1.0000 .9999  .9999  .9999  .9998  .9998  .9997 
13 |1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 
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TABLE B (continued) 


n — 15 (continued) 


хоче л Ban © 


o — 
> шә м ~ о 


1. 
k 
l. 
l. 


: 
E 
5: 
© 

88 
: 
Е 


.1550  .1293  .1077 .0895  .0743  .0614  .0507  .0418  .0343 .0281 
.4614  .4115  .3653  .3227  .2839  .2487  .2170  .1885  .1632 .1407 
.7455 7001  .6539  .6074 .5614  .5162  .4723  .4302  .3899 .3518 
9093  .8838  .8552  .8237  .7899  .7540  .7164  .6777  .6381 .5981 
.9752 .9652  .9529  .9382  .9209 .9012  .8789  .8542 .8273  .7982 


y й 9880  .9829  .9765  .9685  .9588  .9473 .9338  .9183 
.9991  .9985 .9976  .9962 .9944  .9920 .9888  .9847  .9796 .9733 
9999 .9998  .9996  .9993  .9989 .9984  .9976  .9964  .9949  .9930 

1.0000 1.0000 .9999 .9999  .9998  .9997  .9996  .9993  .9990  .9985 

1.0000 1.0000 1.0000 1.0000 1.0000 1.0000  .9999  .9999  .9998 .9998 


1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 


VOTADA шым ~ о 
о 
Ф 
— 
ч 
e 
о 
— 
со 


: 
с 
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TABLE B (continued) 


n = 16 (continued) 
21 22 .23 .24 д5 .26 .27 .28 .29 30 


40230  .0188 | .0153 | .0124  .0100  .0081  .0065  .0052  .0042 .0033 
.1209 .1035  .0883  .0750  .0635  .0535  .0450  .0377  .0314 .0261 
3161  .2827  .2517  .2232  .1971  .1733  .1518  .1323  .1149 .0994 
.5582 .5186  .4797  .4417  .4050  .3697  .3360  .3041  .2740 .2459 
.7673 7348  .7009  .6659  .6302  .5940  .5575  .5212  .4853 .4499 


9008  .8812  .8595  .8359  .8103  .7831  .7542  .7239  .6923  .6598 
9658 .9568 .9464 .9342  .9204  .9049  .8875  .8683  .8474  .8247 
9905  .9873  .9834  .9786  .9729  .9660  .9580  .9486  .9379  .9256 
9979  .9970  .9959 .9944  .9925  .9902  .9873  .9837  .9794  .9743 
9996 .9994  .9992  .9988  .9984  .9977  .9969  .9959  .9945 .9929 


.9999  .9999  .9999 9998  .9997  .9996  .9994  .9992  .9989  .9984 
1.0000 1.0000 1.0000 1.0000 1.0000  .9999  .9999  .9999  .9998 .9997 
1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 


31 32 33 34 35 36 37 38 39 40 


0026  .0021  .0016  .0013 .0010  .0008  .0006 4 .0005 .0004 .0003 
0216 0178  .0146  .0120  .0098  .0079 .0064  .0052 .0041 .0033 
0856 .0734 .0626  .0533  .0451 .0380  .0319 .0266  .0222 .0183 
2196 1953  .1730  .1525  .1339  .1170  .1018  .0881  .0759  .0651 
4154  .3819  .3496  .3187  .2892  .2613  .2351  .2105  .1877  .1666 


.6264 .5926  .5584  .5241 4900  .4562  .4230  .3906  .3592  .3288 
8003 7743  .7469  .7181  .6881  .6572  .6254  .5930  .5602  .5272 
9119 .8965  .8795  .8609 .8406  .8187  .7952  .7702  .7438 .7161 
.9683 .9612  .9530  .9436  .9329  .9209  .9074  .8924  .8758  .8577 
.9908 .9883 9852  .9815  .9771  .9720  .9659  .9589 .9509 .9417 


.9979 .9972  .9963  .9952  .9938  .9921  .9900  .9875  .9845 .9809 
.9996  .9995  .9993 .9990  .9987  .9983  .9977  .9970  .9962  .9951 
1.0000 .9999 .9999  .9999 .9998  .9997  .9996  .9995  .9993  .9991 
1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000  .9999  .9999 .9999 
1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 


PONS woo-oo eom-—-co кю, © хоче eoN-O 
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TABLE B (continued) 


n — 16 (continued) 


0001  .0001  .0001  .0001  .0000 3 i 
.0026 .0021 .0016  .0013  .0010  .0008 .0006  .0005  .0003 .0003 
0151  .0124  .0101  .0082  .0066  .0053  .0042  .0034  .0027  .0021 
.0556 .0473 .0400  .0336  .0281  .0234  .0194  .0160  .0131 .0106 
.1471  .1293  .1131  .0985  .0853  .0735  .0630  .0537  .0456  .0384 


2997  .2720  .2457  .2208  .1976  .1759  .1559  .1374  .1205  .1051 
.4942 4613  .4289  .3971  .3660  .3359 .3068  .2790  .2524  .2272 
.6872 .6572  .6264  .5949  .5629  .5306  .4981  .4657  .4335 .4018 
.8381  .8168  .7940  .7698  .7441  .7171  .6889  .6596  .6293  .5982 
9313 9195  .9064  .8919  .8759  .8584  .8393  .8186  .7964  .7728 


Фо моол AC NC 


10 | .9766  .9716  .9658 .9591 .9514 .9426 .9326  .9214  .9089  .8949 
11 |.9938 .9922  .9902  .9879  .9851  .9817 .9778  .9732  .9678 .9616 
12 | .9988  .9984  .9979 .9973  .9965  .9956  .9945  .9931 .9914  .9894 
13 |.9998  .9998  .9997  .9996  .9994  .9993 .9990 .9987  .9984  .9979 
14 |1.0000 1.0000 1.0000 1.0000  .9999  .9999 .9999  .9999  .9998  .9997 


1.0000 1.0000 


1.0000 1.0000 


1.0000 


n = 17 


:01 .02 .03 .04 .05 .06 .07 .08 .09 10 


0 |.8429  .7093 .5958  .4996 4181 3493  .2912  .2423  .2012  .1668 
1 |.9877 .9554  .9091 .8535  .7922  .7283  .6638  .6005  .5396  .4818 
2 | .9994 .9956 .9866 .9714  .9497  .9218  .8882  .8497  .8073 .7618 
3 [1.0000 .9997  .9986 .9960  .9912  .9836  .9727  .9581  .9397  .9174 
4 |1.0000 1.0000 4.9999  .9996 .9988  .9974  .9949  .9911  .9855  .9779 
5 |1.0000 1.0000 1.0000 1.0000  .9999  .9997  .9993  .9985  .9973 .9953 
6 [1.0000 1.0000 1.0000 1.0000 1.0000 1.0000  .9999  .9998  .9996 .9992 
7 |1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 .9999 
8 |1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 


ll .12 .13 14 AS 16 17 18 19 20 


.1379  .1138  .0937  .0770  .0631 | .0516  .0421  .0343  .0278  .0225 
4277 3777  .3318  .2901  .2525  .2187  .1887  .1621  .1387  .1182 
.7142  .6655  .6164  .5676  .5198  .4734  .4289  .3867  .3468 .3096 
.8913 .8617  .8290  .7935  .7556  .7159  .6749 .6331  .5909  .5489 
.9679 .9554  .9402  .9222  .9013  .8776  .8513  .8225 .7913  .7582 


9925  .9886  .9834  .9766  .9681  .9577  .9452  .9305  .9136 .8943 
.9986 9977  .9963  .9944  .9917  .9882  .9837  .9780  .9709  .9623 
9998 .9996 .9993  .9989  .9983  .9973 .9961  .9943  .9920 .9891 
1.0000 .9999  .9999 .9998  .9997  .9995  .9992  .9988  .9982  .9974 
1.0000 1.0000 1.0000 1.0000 1.0000  .9999 .9999 .9998  .9997  .9995 


1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000  .9999 
1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 


KO хоче Бом – о 


— — 
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TABLE B (continued) 


n — 17 Ccontinued) 


21 22 .23 24 25 .26 27 .28 .29 30 


.0182  .0146 .0118  .0094  .0075  .0060  .0047  .0038 .0030 .0023 
1004 | .0849  .0715  .0600  .0501  .0417  .0346  .0286 .0235 .0193 
2751 | .2433 .2141  .1877  .1637  .1422  .1229  .1058 .0907 .0774 
.5073 4667  .4272  .3893  .3530  .3186  .2863  .2560 .2279 .2019 
.7234 6872 6500  .6121  .5739  .5357  .4977 .4604 .4240 .3887 


0 
1 
2 
3 
4 
3 8727 8490  .8230  .7951  .7653  .7339  .7011  .6671 .6323 .5968 
6 .9521 .9402  .9264  .9106  .8929  .8732  .8515 .8279 .8024 .7752 
7 9853 .9806  .9749  .9680  .9598  .9501  .9389  .9261 .9116 .8954 
8 .9963 .9949  .9930  .9906  .9876  .9839  .9794  .9739 .9674 .9597 
9 .9993  .9989 .9984  .9978  .9969  .9958  .9943  .9925 .9902 .9873 


10 .9999  .9998 9997  .9996  .9994 .9991  .9987  .9982 .9976 .9968 
11 |1.0000 1.0000 1.0000  .9999  .9999  .9998  .9998 .9997 .9995 .9993 
12 |1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 .9999 .9999 
13 | 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 


31 32 33 34 35 36 37 38 39 40 


0018 0014  .0011  .0009 | .0007  .0005  .0004  .0003 .0002 .0002 
0157 0128 .0104 | .0083  .0067  .0054  .0043  .0034 .0027 .0021 
0657 .0556  .0468 | .0392  .0327  .0272  .0225  .0185 .0151 .0123 
.1781  .1563  .1366  .1188  .1028  .0885  .0759  .0648 .0550 .0464 
3547 3222  .2913  .2622  .2348  .2094 | .1858  .1640 .1441 .1260 


0 
1 
2 
3 
4 
5 .9610 .5251  .4895  .4542  .4197  .3861  .3535  .3222 .2923 .2639 
6 .7464  .7162  .6847  .6521  .6188  .5848  .5505  .5161 .4818 .4478 
7 .8773  .8574  .8358  .8123  .7872  .7605  .7324  .7029 .6722 .6405 
8 9508 9405 .9288  .9155  .9006  .8841  .8659 .8459 .8243 .8011 
9 .9838 .9796  .9746  .9686  .9617  .9536  .9443  .9336 .9216 .9081 


10 .9957 .9943  .9926  .9905  .9880  .9849  .9811  .9766 .9714 .9652 
11 9991 .9987  .9983  .9977  .9970  .9960  .9949 .9934 .9916 .9894 
12 .9998 .9998 9997  .9996  .9994  .9992  .9989 .9985 .9981 .9975 
13 | 1.0000 1.0000 1.0000  .9999  .9999  .9999  .9998  .9998 .9997 .9995 
14 | 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 .9999 


15 | 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 
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TABLE B (continued) 


n — 17 (continued) 


0 
1 
2 
3 
4 
5 
6 
7 
8 
9 


-— 
e 


8345  .6951  .5780 .4796  .3972  .3283  .2708  .2229 .1831  .1501 
.9862  .9505  .8997  .8393  .7735  .7055  .6378  .5719  .5091  .4503 
.9993  .9948  .9843  .9667  .9419  .9102  .8725  .8298  .7832  .7338 
1.0000 .9996 .9982  .9950 .9891  .9799  .9667  .9494  .9277  .9018 
1.0000 1.0000 .9998  .9994 .9985 .9966  .9933  .9884  .9814 .9718 


1.0000 1.0000 1.0000  .9999 .9998  .9995  .9990  .9979  .9962  .9936 
1.0000 1.0000 1.0000 1.0000 1.0000 1.0000  .9999  .9997  .9994 .9988 
1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000  .9999 .9998 
1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 


.12 .13 14 15 16 17 18 .19 20 


E 
o| AE чь сою юр 


1227 1002  .0815  .0662  .0536  .0434  .0349  .0281  .0225 .0180 
.3958 3460 .3008  .2602  .2241  .1920  .1638  .1391  .1176 .0991 
.6827  .6310  .5794  .5287  .4797  .4327  .3881  .3462  .3073  .2713 
.8718  .8382  .8014  .7618  .7202  .6771  .6331  .5888  .5446 .5010 
9595 .9442  .9257  .9041  .8794  .8518 .8213  .7884  .7533 .7164 


9898  .9846  .9778  .9690 .9581  .9449  .9292  .9111  .8903  .8671 
.9979  .9966 .9946  .9919  .9882  .9833  .9771 .9694  .9600  .9487 
.9997  .9994  .9989  .9983  .9973  .9959 .9940 .9914  .9880  .9837 
1.0000 .9999 .9998  .9997 .9995  .9992 .9987  .9980  .9971  .9957 
1.0000 1.0000 1.0000 1.0000 .9999 .9999 .9998 .9996  .9994  .9991 


1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 .9999  .9999  .9998 
1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 


KO шомооло on 


— — 
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TABLE B (continued) 


n = 18 (continued) 
21 .22 .23 .24 .25 .26 .27 .28 .29 .30 


.0144 .0114 .0091  .0072  .0056 .0044 .0035 .0027 .0021 .0016 
0831 .0694 | .0577  .0478 .0395 .0324 .0265 .0216 .0176 .0142 
.2384 .2084 | .1813  .1570  .1353 .1161 .0991 .0842 .0712 .0600 
4586 4175 3782 3409  .3057 .2728 .2422 .2140 .1881 .1646 
.6780 | .6387 | .5988 .5586  .5187 4792 4406 4032 .3671 .3327 


8414 | 8134 | 7832 7512  .7174  .6824 .6462  .6093 .5719 .5344 
49355 .9201  .9026 | .8829  .8610 .8370 .8109 7829 .7531 .7217 
.9783 977 9637  .9542  .9431  .9301  .9153  .8986  .8800 .8593 
.9940 9917 .9888 | 9852  .9807  .9751  .9684 .9605 .9512 .9404 
9986$ .9980 .9972  .9961  .9946  .9927  .9903  .9873 .9836  .9790 


10 9997 9996 .9994  .9991  .9988  .9982 .9975  .9966  .9954 .9939 
11 | 1.0000 .9999 .9999 .9998 | 9998 .9997 .9995 .9993  .9990 .9986 
12 | 1.0000 1.0000 1.0000 1.0000 1.0000 .9999 .9999 .9999 .9998 .9997 
13 | 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 


м 
© со ч о 0 A4 


31 „82 .33 34 35 36 37 38 39 40 


.0013 | .0010 | .0007 | .0006 .0004 .0003 .0002 .0002 .0001  .0001 
0114  .0092 | .0073 .0058 .0046  .0036  .0028 .0022 .0017 .0013 
0502 0449 .0348 | .0287  .0236  .0193 .0157  .0127  .0103 .0082 
.1432 1241 | 1069 | .0917  .0783  .0665 .0561 .0472 .0394 .0328 
2999 261 .2402 | .2134  .1886 .1659 .1451  .1263 .1093 .0942 


4971 4602 | 4241 3889 | 3550 3224 .2914 .2621 .2345 .2088 
.6889 | .6550 |  .6202 | .5849  .5491 .5133 .4776 4424 4079 .3743 
48367 8122 | 7859  .7579  .7283  .6973 .6651 .6319  .5979 .5634 
.9280 | 9139 .8981  .8804  .8609 .8396 .8165 .7916  .7650 .7368 
9736 .9671 9595 .9506  .9403 .9286 .9153  .9003 .8837 .8653 


9920 .9896 .9867 9831  .9788 .9736  .9675  .9603  .9520 .9424 
.9980 | .9973 .9964 .9953  .9938  .9920 .9898 .9870 .9837 .9797 
9996 .9995 | 9992  .9989  .9986  .9981  .9974 .9966  .9956 .9942 
.9999 .9999 9999 9998  .9997  .9996  .9995  .9993 .9990 .9987 
1.0000 1.0000 1.0000 1.0000 1.0000 .9999 .9999 .9999  .9998 .9998 


15 | 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 


————— х 
PON Фо ро моол Бом © 
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TABLE B (continued) 


n — 18 (continued) 


| А 1 i : .0000 . ; $ à 
.0010 .0008 .0006  .0004  .0003  .0002  .0002  .0001  .0001  .0001 
.0066  .0052  .0041  .0032  .0025  .0019  .0015  .0011  .0009  .0007 
0271 .0223  .0182  .0148  .0120  .0096  .0077  .0061  .0048 .0038 
0807 .0687 .0582  .0490  .0411  .0342  .0283  .0233  .0190  .0154 


.1849  .1628  .1427  .1243  .1077  .0928  .0795  .0676  .0572  .0481 
3418 3105  .2807  .2524  .2258  .2009  .1778  .1564  .1368  .1189 
.5287 4938  .4592  .4250 3915  .3588  .3272  .2968  .2678 .2403 
.2072 .6764  .6444  .6115  .5778  .5438  .5094  .4751  .4409 .4073 
8451  .8232  .7996  .7742  .7473  .7188  .6890  .6579  .6258  .5927 


хоче Бомо 


10 | .9314  .9189 .9049 8893 .8720  .8530  .8323  .8098  .7856 .7597 
Il |.9750  .9693 .9628  .9551  .9463  .9362 .9247  .9117  .8972 .8811 
12 | .9926  .9906 .9882  .9853  .9817  .9775  .9725  .9666  .9598 .9519 
13 | .9983 .9978 .9971  .9962 .9951 .9937  .9921  .9900  .9875  .9846 
14 | .9997  .9996 .9994 .9993 .9990 .9987  .9983  .9977  .9971  .9962 
15 |1.0000 .9999  .9999 .9999 .9999 .9998  .9997 .9996  .9995  .9993 
16 |1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 .9999 9999 


1.0000 


01 02 .03 04 05 06 ‚07 08 09 410 


O |.8262  .6812  .5606  .4604  .3774  .3086  .2519  .2051  .1666 .1351 
1 | .9847 .9454 .8900 8249  .7547  .6829  .6121  .5440  .4798 | 4203 
2 | .9991 .9939 .9817 .9616 .9335  .8979 .8561  .8092  .7585  .7054 
3 |1.0000 .9995 .9978  .9939 .9868  .9757  .9602  .9398  .9147  .8850 
4 |1.0000 1.0000 .9998  .9993  .9980  .9956  .9915  .9853  .9765 .9648 
5 
6 
7 
8 


40000 .9999 .9998  .9994  .9986  .9971  .9949  .9914 
0000 


E 
о 
о 
о 
о 
[re] 
о 
io 
© 
о 
со 
Ф 
© 
о 
с 
© 
о 
о 
о 
© 
со 
> 


.0000 


e 
z 
— — — — 
———— 
© 
e 
о 
о 
— 
e 
о 
e 
о 
о 
о 
[re] 
о 
о 
Ф 
© 
© 
© 
© 
© 
© 
- 


.0000 


11 .12 13 14 .15 .16 17 18 19 20 


.1092 .0881  .0709  .0569  .0456  .0364  .0290  .0230  .0182 .0144 
.3658 .3165  .2723  .2331  .1985  .1682  .1419  .1191  .0996 .0829 
6512  .5968  .5432  .4911  .4413 3941  .3500  .3090  .2713  .2369 
8510  .8133  .7725  .7292  .6841  .6380  .5915  .5451  .4995 .4551 
.9498  .9315  .9096  .8842  .8556  .8238  .7893  .7524  .7136  .6733 


.9865  .9798  .9710  .9599 .9463  .9300 .9109  .8890  .8643  .8369 
.9970 .9952  .9924  .9887 .9837  .9772  .9690  .9589 .9468  .9324 
.9995 .9991 .9984  .9974  .9959 .9939 .9911 .9874 .9827  .9767 
.9999 .9998  .9997 .9995 .9992 .9986 .9979  .9968  .9953  .9933 
1.0000 1.0000 1.0000 .9999  .9999  .9998  .9996  .9993  .9990  .9984 


1.0000 1.0000 1.0000 1.0000 1.0000 1.0000  .9999  .9999 .9998 .9997 
1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 


© 
з 
e 
3 
з 
2 
e 
e 
e 
E 
= 
e 
3 
2 
e 
e 
e 
© 
e 
e 
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TABLE B (continued) 


n = 19 (continued) 


21 22 .23 .24 .25 .26 .27 .28 .29 30 


40113 .0089 | .0070 .0054 .0042  .0033 .0025  .0019 .0015 .0011 
0687 | .0566 .0465  .0381  .0310  .0251 .0203  .0163 .0131 .0104 
208 .1778 | .1529 .1308 | 1113 .0943 .0795 .0667  .0557 .0462 
4123 | 3715 3329  .2968  .2631  .2320  .2035 .1776  .1542 .1332 
6319 |  .5900 | .5480 .5064 .4654  .4256 .3871  .3502 3152 .2822 


0 
І 
2 
3 
4 
5 .8071 17749  .7408  .7050  .6677  .6295  .5907 .5516  .5125  .4739 
6 9157 .8966 | .8751 .8513  .8251 .7968 .7664  .7343  .7005  .6655 
7 9693  .9604 .9497  .9371 .9225 .9059 .8871 .8662  .8432 .8180 
8 9907 .9873 .9831  .9778  .9713  .9634 .9541  .9432  .9306 .9161 
9 9977 | .9966 .9953  .9934 .9911 .9881 .9844 .9798 .9742 .9674 


10 .9995 .9993 .9989 .9984  .9977 .9968 .9956 .9940 .9920 .9895 
11 9999 .9999 .9998  .9997  .9995  .9993 .9990 .9985  .9980 .9972 
12 | 1.0000 1.0000 1.0000  .9999 .9999 .9999 .9998  .9997 .9996 .9994 
13 | 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000  .9999 .9999 
14 | 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 


«91 42 33 34 35 36 37 .38 39 40 
0 
1 
2 
3 
4 
5 
6 
7 
8 
9 


.0009 0007 .0005  .0004 .0003  .0002 .0002 .0001 .0001 .0001 
:0083 .0065 .0051  .0040 .0031 .0024 .0019 .0014 .0011 .0008 
.0382 | .0314 | .0257 .0209 .0170 .0137 .0110 .0087 .0069 .0055 
.1444 .0978 .0831 .0703 .0591 .0495 .0412 .0341 .0281 .0230 
.2514 2227 1963 .1720 .1500 .1301 .1122 .0962 .0821 .0696 


4359 0.3990 .3634 .3293 .2968 .2661 .2373 .2105 .1857  .1629 
.6294 |  .5927 .5555 0.5182 .4812 .4446 4087  .3739 .3403  .3081 
.7909 .7619 .7312 .6990 .6656 .6310 .5957 .5599 .5238  .4878 
.8997 884 .8611 .8388  .8145 .7884 .7605 .7309 .6998  .6675 
29595 .9501 9392 .9267  .9125 .8965 .8787  .8590 .8374 .8139 


10 9865  .9824 .9777  .9720 .9653 .9574 .9482 .9375 .9253  .9115 
11 .9962 .9949 .9932 .9911 .9886 .9854 .9815 .9769 .9713 .9648 
12 9991 .9988 .9983 .9977 .9969 .9959 .9946 .9930 .9909 .9884 
13 .9998  .9998 .9997 .9995 .9993 .9991 .9987 .9983 .9977 .9969 
14 | 1.0000 1.0000 .9999 .9999 .9999 .9998 .9998 .9997 .9995 .9994 


15 | 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000  .9999 .9999 
16 | 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 
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TABLE B (continued) 


n — 19 (continued) 


хоче $WN— © 


.8960  .8787  .8596  .8387  .8159  .7913  .7649  .7369  .7073 .6762 
9571  .9482  .9379  .9262  .9129  .8979  .8813  .8628  .8425  .8204 
9854  .9817  .9773  .9720  .9658  .9585  .9500  .9403 .9291  .9165 
9960 .9948  .9933  .9914  .9891  .9863 .9829  .9788  .9739  .9682 
.9991 .9988  .9984  .9979  .9972  .9964  .9954  .9940  .9924 .9904 


————— 
$ 0) м © 
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TABLE B (continued) 


n — 20 (continued) 
11 19 .13 14 ¿IS .16 47 .18 .19 20 


0972 .0776  .0617  .0490  .0388  .0306  .0241  .0189 .0148 .0115 
3376  .2891  .2461  .2084 1756  .1471  .1227  .1018  .0841 .0692 
6198 .5631  .5080  .4550 .4049  .3580 .3146  .2748  .2386 .2061 
.8290 .7873  .7427  .6959  .6477  .5990  .5504  .5026  .4561 .4114 
.9390  .9173  .8917  .8625  .8298  .7941  .7557 .7151  .6729 .6296 


9825 .9740  .9630  .9493 .9327  .9130  .8902  .8644  .8357 .8042 
.9959  .9933  .9897  .9847 .9781  .9696 .9591  .9463 .9311  .9133 
.9992  .9986  .9976  .9962  .9941  .9912  .9873  .9823  .9759 .9679 
.9999 .9998  .9995  .9992  .9987  .9979  .9967  .9951  .9929  .9900 
1.0000 1.0000 .9999  .9999  .9998 .9996  .9993  .9989  .9983  .9974 


1.0000 1.0000 1.0000 1.0000 1.0000 .9999  .9999  .9998  .9996  .9994 
1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000  .9999 .9999 


— * 
© хоче CN HN—co 


— 
— 


12 | 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 
.21 22 23 24 25 26 27 28 29 30 
0 | .0090 .0069 | .0054  .0041  .0032  .0024  .0018 .0014 .0011 .0008 
1 | 0566  .0461  .0374  .0302  .0243 | .0195  .0155  .0123  .0097 .0076 
2 | 1770 .1512 .1284 .1085 .0913  .0763  .0635  .0526  .0433 .0355 
3 | .3690 .3289  .2915  .2569  .2252  .1962  .1700  .1466  .1256  .1071 
4 | .5858  .5420 .4986  .4561  .4148  .3752  .3375  .3019  .2685 .2375 
5 | .7703 .7343  .6965  .6573  .6172  .5765  .5357  .4952  .4553  .4164 
6 | 89299  .8699  .8442  .8162  .7858  .7533  .7190  .6831  .6460  .6080 
7 | .9581  .9464  .9325  .9165  .8982  .8775  .8545  .8293  .8018 .7723 
8 | .9862  .9814 .9754  .9680  .9591  .9485  .9360 .9216  .9052 .8867 
9 | .9962  .9946  .9925  .9897 .9861 .9817  .9762  .9695  .9615 .9520 
10 | 9991  .9987  .9981 .9972 .9961  .9945 .9926  .9900  .9868 .9829 


11 | .9998  .9997  .9996 .9994 .9991 0 .9986 .9981  .9973  .9962  .9949 
12 |1.0000 1.0000 .9999 .9999  .9998  .9997  .9996  .9994  .9991  .9987 
13 |1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 .9999  .9999  .9998 .9997 
14 |1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 
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TABLE B (continued) 


A 
m 
= 


Фо моол ьо м о 


Фо моол Бомо 


— — 
—© 


12 


32 


0004 
‚0047 
0235 
.0765 
.1827 


3426 
5307 
‚7078 
8432 
.9281 


.9721 
.9909 
.9975 
.9994 
.9999 


1.0000 
1.0000 


42 


0000 
.0003 
.0021 
.0102 
.0349 


.0922 
.1959 
3461 
5229 
6936 


.8295 
.9190 
.9676 
.9893 
.9971 


.9994 
.9999 
1.0000 
1.0000 


33 


0003 
0036 
0189 
0642 
‚1589 


.3082 
.4921 
6732 
8182 
9134 


.9650 
.9881 
.9966 
.9992 
‚9999 


1.0000 
1.0000 


43 


0000 
‚0002 
0016 
0080 
.0286 


.0783 
.1719 
.3132 
4864 
.6606 


.8051 
.9042 
.9603 
.9864 
.9962 


.9992 
.9999 
1.0000 
1.0000 


n = 20 (continued) 


34 


0002 
0028 
0152 
0535 
.1374 


.2758 
4540 
6376 
.7913 
.8968 


.9566 
.9846 
.9955 
.9989 
.9998 


1.0000 
1.0000 


44 


.0000 
.0002 
.0012 
.0063 
.0233 


.0660 
.1499 
.2817 
.4501 
.6264 


.7788 
.8877 
.9518 
.9828 
.9950 


.9989 
.9998 
1.0000 
1.0000 


35 


0002 
.0021 
.0121 
0444 
‚1182 


.2454 
4166 
.6010 
.7624 
.8782 


.9468 
.9804 
.9940 
.9985 
.9997 


1.0000 
1.0000 


45 


.0000 
.0001 
.0009 
.0049 
.0189 


.0553 
.1299 
.2520 
.4143 
5914 


‚7507 
.8692 
.9420 
.9786 
.9936 


.9985 
.9997 
1.0000 
1.0000 


.36 


.37 


0001 
0012 
‚0076 
0300 
.0859 


.1910 
.3453 
.5265 
.6995 
.8350 


.9225 
-9692 
.9898 
.9972 
.9994 


.9999 
1.0000 


47 


0000 
.0001 
.0005 
.0029 
.0121 


.0381 
.0958 
.1980 
3454 
.5196 


.6896 
8266 
9177 
.9674 
.9895 


.9973 
.9995 
.9999 
1.0000 


0000 
0004 
‚0023 
0096 


0313 
0814 
‚1739 
.3127 
.4834 


6568 
‚8024 
.9031 
.9603 
.9867 


.9965 
.9993 
.9999 
1.0000 


.39 


.0001 
.0007 
.0047 
.0198 
.0610 


.1453 
.2800 
4522 
6312 
.7837 


.8910 
.9534 
.9833 
.9951 
.9988 


.9998 
1.0000 


49 


.0000 
.0000 
.0003 
.0017 
.0076 


.0255 
.0688 
.1518 
.2814 
4474 


.6229 
.7762 
.8867 
.9520 
.9834 


.9954 
.9990 
.9999 
1.0000 
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TABLE B (continued) 


3 

З 
55555 

S 

2 

S 


.0543 .0409  .0308  .0230  .0172  .0128  .0095  .0070  .0052 .0038 
2221  .1805  .1457  .1168  .0931  .0737  .0580  .0454  .0354 .0274 
4709 .4088 3517  .3000  .2537  .2130  .1774  .1467  .1204 .0982 
7066 .6475  .5877  .5286  .4711  .4163  .3648 .3171  .2734 .2340 
.8669  .8266  .7817  .7332  .6821  .6293  .5759  .5228  .4708 .4207 


9501  .9291  .9035  .8732  .8385  .7998  .7575  .7125  .6653  .6167 
9844 97577  .9641  .9491  .9305  .9080  .8815  .8512  .8173  .7800 
.9959  .9930  .9887  .9827  .9745  .9639  .9505  .9339 .9141 .8909 
.9991 .9983  .9970  .9950  .9920  .9879  .9822  .9748  .9652 .9532 
.9998  .9996  .9993  .9987  .9979  .9965  .9945  .9917  .9878 .9827 


1.0000 .9999  .9999  .9997 .9995 .9991  .9985  .9976  .9963  .9944 
1.0000 1.0000 1.0000 1.0000 .9999 .9998  .9997  .9994  .9990  .9985 
1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 .9999  .9999  .9998  .9996 
1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 .9999 
1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 


ROPS омос e&om-o © оочатт UNO 
- 
= 
ко 
is 
© 
- 
A 
m 
сл 
т 
E. 
ч 
= 
A 
© 
ho 
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TABLE B (continued) 


" 


(Qo ADO €£$ WN о 


.0028 
0211 
.0796 
.1987 
.3730 


9675 
.7399 
8642 
.9386 
.9760 


.9918 
.9976 
.9994 
.9999 
1.0000 


1.0000 
1.0000 
1.0000 


:0001 
0011 
0068 
0263 
0746 


.1656 
3019 
4681 
6361 
‚7787 


8812 
9440 
.9770 
.9917 
.9974 


.9993 
.9998 
1.0000 
1.0000 
1.0000 
1.0000 


.22 


.0020 
.0162 
.0640 
.1676 
.3282 


.5184 
.6973 
.8342 
.9212 
9675 


‚9883 
.9964 
.9990 
.9998 
1.0000 


1.0000 
1.0000 
1.0000 


32 


0001 
0008 
0051 
‚0207 
0610 


.1407 
2657 
4253 
.5943 
‚7445 


‚8576 
‚9302 
‚9701 
.9888 
.9964 


.9990 
.9998 
1.0000 
1.0000 
1.0000 
1.0000 


29 


0015 
0123 
0512 
‚1403 
.2866 


4701 
6529 
8011 
‚9007 
.9569 


.9837 
‚9947 
.9985 
.9996 
.9999 


1.0000 
1.0000 
1.0000 


¿39 


.0000 
0006 
‚0039 
0162 
0496 


‚1187 
‚2821 
‚3837 
.5518 
.7081 


.8314 
9141 
9617 
‚9851 
‚9950 


9985 
.9996 
.9999 
1.0000 
1.0000 
1.0000 


n = 25 (continued) 


24 


0010 
.0093 
.0407 
.1166 


.2484 


.4233 
.6073 
.7651 
.8772 
.9440 


.9778 
.9924 
.9977 
.9994 
.9999 


1.0000 
1.0000 
1.0000 


25 


.0008 
.0070 
.0321 
.0962 
.2137 


.3783 
9611 
.7265 
.8506 
.9287 


.9703 
.9893 
.9966 
.9991 
.9998 


1.0000 
1.0000 
1.0000 


¿30 


.0000 
.0003 
.0021 
.0097 
.0320 


.0826 
.1734 
.3061 
.4668 
.6303 


44112 
.8746 
.9396 
.9745 
.9907 


‚9971 
‚9992 
9998 
1.0000 
1.0000 
1.0000 


.26 


-0005 
.0053 
.0252 
.0789 
.1826 


.3356 
.5149 
.6858 
.8210 
.9107 


9611 
.9852 
.9951 
.9986 
.9997 


.9999 
1.0000 
1.0000 


36 


.0000 
.0002 
.0016 
.0074 
.0255 


.0682 
.1483 
.2705 
.4252 
.5896 


‚7375 
.8510 
.9255 
.9674 
.9876 


.9959 
.9989 
.9997 
.9999 
1.0000 
1.0000 


27 


0004 
0039 
0196 
0642 
‚1548 


.2956 
.4692 
.6435 
.7885 
.8899 


.9498 
.9801 
.9931 
.9979 
.9995 


.9999 
1.0000 
1.0000 


94 


.0000 
.0002 
.0011 
.0056 
.0201 


.0559 
.1258 
.2374 
.3848 
.5483 


.7019 
.8249 
.9093 
.9588 
.9837 


.9944 
.9984 
.9996 
.9999 
1.0000 
1.0000 


28 


0003 
0029 
0152 
0519 
1304 


.2585 
4247 
.6001 
.7535 
.8662 


.9364 
.9736 
.9904 
.9970 
.9992 


.9998 
1.0000 
1.0000 


.38 


.0000 
.0001 
.0008 
.0043 
.0158 


.0454 
.1060 
.2068 
.3458 
.5067 


.6645 
.7964 
.8907 
.9485 
.9788 


.9925 
.9977 
.9994 
.9999 
1.0000 
1.0000 


29 


.0002 
.0021 
0117 
‚0417 
‚1090 


.2245 
.3817 
.5560 
‚7162 
8398 


.9205 
.9655 
.9870 
.9957 
.9988 


.9997 
.9999 
1.0000 


.39 


.0000 
.0001 
.0006 
.0032 
.0123 


.0367 
.0886 
.1789 
.3086 
4653 


.6257 
.7654 
.8697 
.9363 
.9729 


.9900 
.9968 
.9992 
.9998 
1.0000 
1.0000 


30 


.0001 
.0016 
.0090 
.0332 
.0905 


.1935 
3407 
5118 
.6769 
‚8106 


9022 
9558 
9825 
‚9940 
9982 


9995 
.9999 
1.0000 


.40 


.0000 
.0001 
.0004 
.0024 
.0095 


.0294 
.0736 
.1536 
.2735 
.4246 


.5858 
.7323 
.8462 
.9222 
.9656 


.9868 
.9957 
.9988 
.9997 
.9999 
1.0000 
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TABLE B (continued) 


n = 25 (continued) 
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TABLE C Cumulative Poisson Distribution P(X = X|A). 1000 Times the 


Probability of X or Fewer Occurrences of Event That Has Average Number of 
Occurrences Equal to A 


х х м 
OC RO м ~ о CO м ~ © оо м ~ © 


.02 


980 
1000 


472 


1000 


0 


1000 


П 


123 4 5 6 
p(x < 2 |.= 1.00) = .920 


1000 


1000 
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TABLE C (continued) 


VA 
= 
Ko 
— 
[5 
EN 
m 
[2 
o 
- 
ма 
— 
со 
— 
о 


0 301 273 247 223 202 183 165 150 
1 663 627 592 558 525 493 463 434 
2 879 857 833 809 783 757 731 704 
3 966 957 946 934 921 907 891 875 
4 992 989 986 981 976 970 964 956 
5 998 998 997 996 994 992 990 987 
6 1000 1000 999 999 999 998 997 997 
7 1000 1000 1000 1000 999 999 
8 1000 1000 


4 
ю 
© 
N 
һә 
N 
> 
N 
a 
ко 
со 
e 
© 
[24] 
KN 
wo 
> 


0 135 111 091 074 061 050 041 033 
1 406 355 308 267 231 199 171 147 
2 677 623 570 518 469 423 380 340 
3 857 819 779 736 692 647 603 558 
4 947 928 904 877 848 815 781 744 
5 983 975 964 951 935 916 895 871 
6 995 993 988 983 976 966 955 942 
7 999 998 997 995 992 988 983 977 
8 1000 1000 999 999 998 997 994 992 
9 1000 1000 999 999 998 997 
10 1000 1000 1000 999 
11 1000 


VA 
99 
a 
oo 
eo 
ць 
о 
+ 
кә 
+ 
> 
> 
с 
ць 
со 
a 
© 


0 027 022 018 015 012 010 008 007 
1 126 107 092 078 066 056 048 040 
2 303 269 238 210 185 163 143 125 
3 515 473 433 395 359 326 294 265 
4 706 668 629 590 551 513 476 440 
5 844 816 785 753 720 686 651 616 
6 927 909 889 867 844 818 791 762 
7 969 960 949 936 921 905 887 867 
8 988 984 979 972 964 955 944 932 
9 996 994 992 989 985 980 975 968 
10 999 998 997 996 994 992 990 986 
11 1000 999 999 999 998 997 996 995 
12 1000 1000 1000 999 999 999 998 
13 1000 1000 1000 999 
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TABLE C (continued) 


5.2 54 5.6 5.8 6.0 6.2 6.4 6.6 
0 006 005 004 003 002 002 002 001 
1 034 029 024 021 017 015 012 010 
2 109 095 082 072 062 054 046 040 
3 238 213 191 170 151 134 119 105 
4 406 373 342 313 285 259 235 213 
5 581 546 512 478 446 414 384 355 
6 732 702 670 638 606 574 542 511 
7 845 822 797 771 744 716 687 658 
8 918 903 886 867 847 826 803 780 
9 960 951 941 929 916 902 886 869 
10 982 977 972 965 957 949 939 927 
11 993 990 988 984 980 975 969 963 
12 997 996 995 993 991 989 986 982 
13 999 999 998 997 996 995 994 992 
14 1000 999 999 999 999 998 997 997 
15 1000 1000 1000 999 999 999 999 
16 1000 1000 1000 999 
17 1000 
6.8 7.0 7.2 7.4 7.6 7.8 8.0 8.5 
0 001 001 001 001 001 000 000 000 
1 009 007 006 005 004 004 003 002 
2 034 030 025 022 019 016 014 009 
3 093 082 072 063 055 048 042 030 
4 192 173 156 140 125 112 100 074 
5 327 301 276 253 231 210 191 150 
6 480 450 420 392 365 338 313 256 
7 628 599 569 539 510 481 453 386 
8 755 729 703 676 648 620 593 523 
9 850 830 810 788 765 741 717 653 
10 915 901 887 871 854 835 816 763 
11 955 947 937 926 915 902 888 849 
12 978 973 967 961 954 945 936 909 
13 990 987 984 980 976 971 966 949 
14 996 994 993 991 989 986 983 973 
15 998 998 997 996 995 993 992 986 
16 999 999 999 998 998 997 996 993 
17 1000 1000 999 999 999 999 998 997 
18 1000 1000 1000 1000 999 999 
19 1000 999 


20 1000 
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TABLE C (continued) 


x 9.0 9.5 10.0 10.5 11.0 11.5 12.0 12.5 
1 001 001 000 000 000 000 000 000 
2 006 004 003 002 001 001 001 000 
3 021 015 010 007 005 003 002 002 
4 055 040 029 021 015 011 008 005 
5 116 089 067 050 038 028 020 015 
6 207 165 130 102 079 060 046 035 
$ 324 269 220 179 143 114 090 070 
8 456 392 333 279 232 191 155 125 
9 587 522 458 397 341 289 242 201 

10 706 645 583 521 460 402 347 297 
11 803 752 697 639 579 520 462 406 
12 876 836 792 742 689 633 576 519 
13 926 898 864 825 781 733 682 628 
14 959 940 917 888 854 815 772 725 
15 978 967 951 932 907 878 844 806 
16 989 982 973 960 944 924 899 869 
17 995 991 986 978 968 954 937 916 
18 998 996 993 988 982 974 963 948 
19 999 998 997 994 991 986 979 969 
20 1000 999 998 997 995 992 988 983 
21 1000 999 999 998 996 994 991 
22 1000 999 999 998 997 995 
23 1000 1000 999 999 998 
24 1000 999 999 
25 1000 999 
26 1000 
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TABLE C (continued) 
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TABLE C (continued) 
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TABLE D Normal Curve Areas P(z = zy). Entries in the Body of the Table Are 
Areas Between -œ and z 


—0.09 —0.08 —0.07 


0001 
0001 
0001 


0002 
0003 
0004 
0005 
0007 


0010 
0014 
0020 
0027 
0037 


0049 
0066 
.0087 
0113 
0146 


0188 
0239 
.0301 
.0375 
0465 


.0571 
0694 
0838 
-1003 
-1190 


.1401 
.1635 
.1894 
.2177 
2483 


2810 
3156 
3520 
3897 
.4286 


4681 


:0001 
:0001 
:0001 


0002 
0002 
0003 
0005 
0007 


0010 
0014 
0019 
.0026 
0036 


0048 
0064 
0084 
0110 
0143 


.0183 
.0233 
.0294 
0367 
10455 


0559 
.0681 
.0823 
.0985 
.1170 


.1379 
.1611 
.1867 
.2148 
.2451 


22776 
3121 
3483 
3859 
4247 


4641 


0001 
0001 
0001 


0002 
0003 
0004 
0005 
0008 


0011 
0015 
0021 
0028 
0038 


0051 
0068 


.9750 


1.96 


—0.04 —0.03 - 0.02 


.0001 
0001 
0001 


0002 
0003 
0004 
0006 
0009 


0012 
0017 
0023 
‚0032 
0043 


‚0057 
0075 
0099 
0129 
0166 


0212 
.0268 
.0336 
.0418 
.0516 


.0630 
.0764 
.0918 
.1093 
.1292 


.1515 
.1762 
2033 
.2327 
.2643 


.2981 
.3336 
3707 
4090 
4483 


4880 


.0001 
:0001 
.0001 


0002 
0003 
0004 
0006 
0008 


0012 
0016 
0023 
0031 
0041 


0055 
.0073 
.0096 
.0125 
.0162 


.0207 
:0262 
.0329 
.0409 
.0505 


.0618 
.0749 
.0901 
.1075 
.1271 


.1492 
.1736 
-2005 
-2296 
2611 


.2946 
.3300 
3669 
4052 
4443 


4840 


РА 


:0001 
.0001 
.0001 


0002 
0003 
0005 
0006 
0009 


0013 
0018 
0024 
0033 
0044 


0059 
0078 
0102 
0132 
0170 


0217 
0274 
0344 
0427 
0526 


0643 
0778 
0934 
1112 
1314 


„1539 
.1788 
.2061 
.2358 
.2676 


.3015 
8372 
3745 
4129 
4522 


4920 


= 0.01 


0001 
0001 
0002 


0002 
0003 
0005 
0007 
0009 


0013 
0018 
0025 
0034 
0045 


0060 
0080 
0104 
0136 
0174 


0222 
0281 
‚0351 
0436 
0537 


0655 
0793 
0951 
1181 
.1335 


.1562 
.1814 
.2090 
.2389 
.2709 


.3050 
.3409 
.3783 
4168 
4562 


4960 


0.00 


0001 
0001 
0002 


0002 
0003 
0005 
0007 
0010 


0013 
0019 
0026 
0035 
0047 


.0062 
.0082 
.0107 
.0139 
.0179 


.0228 
.0287 
.0359 
0446 
0548 


.0668 
.0808 
.0968 
.1151 
.1357 


.1587 
.1841 
.2119 
.2420 
.2743 


.3085 
3446 
3821 
4207 
4602 


-5000 


TABLE D (continued) 
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0.00 


.5000 
.5398 
.5793 
.6179 
‚6554 


‚6915 
.7257 
.7580 
.7881 
.8159 


.8413 
.8643 
.8849 
.9032 
.9192 


.9332 
.9452 
.9554 
.9641 
.9713 


.9772 
.9821 
.9861 
.9893 
.9918 


.9938 
.9953 
.9965 
.9974 
.9981 


.9987 
.9990 
.9993 
.9995 
.9997 


.9998 
.9998 
.9999 
.9999 


0.01 


.5040 
.5438 
.5832 
.6217 
.6591 


.6950 
.7291 
7611 
.7910 
.8186 


.8438 
.8665 
.8869 
9049 
.9207 


.9345 
.9463 
.9564 
.9649 
.9719 


.9778 
9826 
9864 
9896 
19920 


9940 
9955 
9966 
9975 
.9982 


.9987 
.9991 
‚9993 
9995 
.9997 


.9998 
.9998 
.9999 
‚9999 


0.02 


.5080 
.5478 
.5871 
.6255 
.6628 


.6985 
.7324 
.7642 
1939 
8212 


8461 
8686 
8888 
9066 
9222 


‚9357 
9474 
.9573 
.9656 
.9726 


.9783 
.9830 
.9868 
.9898 
.9922 


.9941 
.9956 
.9967 
.9976 
.9982 


.9987 
.9991 
.9994 
.9995 
.9997 


.9998 
.9999 
.9999 
.9999 


0.03 


.5120 
5517 
5910 
.6293 
.6664 


‚7019 
.1357 
17673 
.7967 
.8238 


.8485 
.8708 
.8907 
.9082 
.9236 


.9370 
.9484 
.9582 
.9664 
.9732 


.9788 
.9834 
.9871 
.9901 
.9925 


.9943 
.9957 
.9968 
9977 
.9983 


.9988 
.9991 
.9994 
.9996 
.9997 


.9998 
.9999 
.9999 
.9999 


0.04 


.5160 
.5557 
.5948 
.6331 
.6700 


.7054 
.7389 
‚7704 
‚7995 
‚8264 


.8508 
.8729 
.8925 
.9099 
.9251 


.9382 
.9495 
.9591 
.9671 
.9738 


.9793 
.9838 
.9875 
.9904 
.9927 


.9945 
.9959 
.9969 
.9977 
.9984 


.9988 
.9992 
.9994 
.9996 
.9997 


.9998 
.9999 
.9999 
.9999 


0.05 


.5199 
.5596 
.5987 
.6368 
.6736 


.7088 
‚7422 
‚7734 
.8023 
.8289 


.8531 
.8749 
.8944 
9115 
‚9265 


.9394 
.9505 
.9599 
.9678 
.9744 


.9798 
.9842 
.9878 
.9906 
.9929 


.9946 
.9960 
.9970 
.9978 
.9984 


.9989 
9992 
9994 
‚9996 
.9997 


.9998 
‚9999 
‚9999 
.9999 


0.06 


.9239 
.5636 
.6026 
.6406 
.6772 


.7123 
.7454 
.7764 
.8051 
.8315 


.8554 
.8770 
.8962 
.9131 
.9279 


.9406 
.9515 
.9608 
.9686 
.9750 


.9803 
.9846 
.9881 
-9909 
9931 


9948 
.9961 
.9971 
.9979 
.9985 


.9989 
‚9992 
9994 
9996 
.9997 


.9998 
.9999 
.9999 
.9999 


0.07 


.5279 
.5675 
.6064 
.6443 
.6808 


.7157 
.7486 
.7794 
.8078 
.8340 


.8577 
.8790 
.8980 
9147 
9292 


9418 
9525 
.9616 
.9693 
.9756 


.9808 
.9850 
.9884 
.9911 
.9932 


.9949 
.9962 
.9972 
.9979 
.9985 


.9989 
.9992 
.9995 
.9996 
.9997 


.9998 
.9999 
.9999 
.9999 


0.08 


.9319 
3714 
6103 
6480 
6844 


‚7190 
4517 
.7823 
.8106 
.8365 


.8599 
.8810 
.8997 
.9162 
49306 


9429 
9535 
9625 
9699 
9761 


9812 
9854 
9887 
.9913 
.9934 


.9951 
.9963 
.9973 
.9980 
.9986 


.9990 
.9993 
.9995 
.9996 
.9997 


.9998 
.9999 
9999 
.9999 


0.09 


9359 
9753 
6141 
-6517 
.6879 


.7224 
.7549 
.7852 
.8133 
.8389 


.8621 
.8830 
.9015 
9177 
.9319 


.9441 
.9545 
.9633 
.9706 
.9767 


.9817 
.9857 
.9890 
.9916 
.9936 


.9952 
.9964 
.9974 
.9981 
.9986 


.9990 
.9993 
.9995 
.9997 
.9998 


.9998 
„9999 
.9999 
.9999 


A-40 APPENDIX STATISTICAL TABLES 


TABLE E Percentiles of the t Distribution 


2. 
m 


о со DO оом ~ 


-975 


0 2.2281 


p 49 € 2.2281) = .975 


t s 


6.3138 
2.9200 
2.3534 
2.1318 
2.0150 
1.9432 
1.8946 
1.8595 
1.8331 
1.8125 
1.7959 
1.7823 
1.7709 
1.7613 
1.7530 
1.7459 
1.7396 
1.7341 
1.7291 
1.7247 
1.7207 
1.7171 
1.7139 
1.7109 
1.7081 
1.7056 
1.7033 
1.7011 
1.6991 
1.6973 
1.6896 
1.6839 
1.6794 
1.6759 
1.6707 
1.6669 
1.6641 
1.6620 
1.6602 
1.6577 
1.6558 
1.6545 
1.6534 
1.6525 
1.645 


t 975 


12.706 
4.3027 
3.1825 
2.7764 
2.5706 
2.4469 
2.3646 
2.3060 
2.2622 
2.2281 
2.2010 
2.1788 
2.1604 
2.1448 
2.1315 
2.1199 
2.1098 
2.1009 
2.0930 
2.0860 
2.0796 
2.0739 
2.0687 
2.0639 
2.0595 
2.0555 
2.0518 
2.0484 
2.0452 
2.0423 
2.0301 
2.0211 
2.0141 
2.0086 
2.0003 
1.9945 
1.9901 
1.9867 
1.9840 
1.9799 
1.9771 
1.9749 
1.9733 
1.9719 
1.96 


110 


t 99 
31.821 


t 995 


63.657 
9.9248 
5.8409 
4.6041 
4.0321 
3.7074 
3.4995 
3.3554 
3.2498 
3.1693 
3.1058 
3.0545 
3.0123 
2.9768 
2.9467 
2.9208 
2.8982 
2.8784 
2.8609 
2.8453 
2.8314 
2.8188 
2.8073 
2.7969 
2.7874 
2.7787 
2.7707 
2.7633 
2.7564 
2.7500 
2.7239 
2.7045 
2.6896 
2.6778 
2.6603 
2.6480 
2.6388 
2.6316 
2.6260 
2.6175 
2.6114 
2.6070 
2.6035 
2.6006 
2.576 
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TABLE F Percentiles of the Chi-Square Distribution 


A-41 


COON осол о м – | m 


Хо 
0000393 
0100 
0717 
.207 
412 
.676 
.989 

1.344 
1.735 
2.156 
2.603 
3.074 
3.565 
4.075 
4.601 
5.142 
5.697 
6.265 
6.844 
7.434 
8.034 
8.643 
9.260 
9.886 
10.520 
11.160 
11.808 
12.461 
13.121 
13.787 


17.192 
20.707 
24.311 
27.991 
35.535 
43.275 
51.172 
59.196 
67.328 


Xs 
.000982 
.0506 
.216 
484 
.831 

1.237 
1.690 
2.180 
2.700 
3.247 
3.816 
4.404 
5.009 
5.629 
6.262 
6.908 
7.564 
8.231 
8.907 
9.591 
10.283 
10.982 
11.688 
12.401 
13.120 
13.844 
14.573 
15.308 
16.047 
16.791 


20.569 
24.433 
28.366 
32.357 
40.482 
48.758 
57.153 
65.647 
74.222 


p (x2, $ 31.410) = 95 


xs 
.00393 
.103 
359 
711 
1.145 
1.635 
2.167 
2.733 
3.325 
3.940 
4.575 
5.226 
5.892 
6.571 
7.261 
7.962 
8.672 
9.390 
10.117 
10.851 
11.591 
12.338 
13.091 
13.848 
14.611 
15.379 
16.151 
16.928 
17.708 
18.493 


22.465 
26.509 
30.612 
34.764 
43.188 
51.739 
60.391 
69.126 
77.929 


31.410 = 


Xo 
2.706 
4.605 
6.251 
7.779 
9.236 
10.645 
12.017 
13.362 
14.684 
15.987 
17.275 
18.549 
19.812 
21.064 
22.307 
23.542 
24.769 
25.989 
27.204 
28.412 
29.615 
30.813 
32.007 
33.196 
34.382 
35.563 
36.741 
37.916 
39.087 
40.256 


46.059 
51.805 
57.505 
63.167 
74.397 
85.527 
96.578 
107.565 
118.498 


хі 
3.841 
5.991 
7.815 
9.488 
11.070 
19.599 
14.067 
15.507 
16.919 
18.307 
19.675 
21.026 
22.362 
23.685 
24.996 
26.296 
97.587 
28.869 
30.144 
31.410 
32.671 
33.924 
35.172 
36.415 
37.652 
38.885 
40.113 
41.337 
49.557 
43.773 


49.802 
55.758 
61.656 
67.505 
79.082 
90.531 
101.879 
113.145 
124.342 


Хі» 
5.024 
7.378 
9.348 
11.143 
12.832 
14.449 
16.013 
17.535 
19.023 
20.483 
21.920 
23.336 
24.736 
26.119 
27.488 
28.845 
30.191 
31.526 
32.852 
34.170 
35.479 
36.781 
38.076 
39.364 
40.646 
41.923 
43.194 
44.461 
45.722 
46.979 


53.203 
59.342 
65.410 
71.420 
83.298 
95.023 
106.629 
118.136 
129.561 


Xo 

6.635 

9.210 
11.345 
13.277 
15.086 
16.812 
18.475 
20.090 
21.666 
23.209 
94.795 
26.217 
27.688 
29.141 
30.578 
32.000 
33.409 
34.805 
36.191 
37.566 
38.932 
40.289 
41.638 
42.980 
44.314 
45.642 
46.963 
48.278 
49.588 
50.892 


57.342 
63.691 
69.957 
76.154 
88.379 
100.425 
112,329 
124.116 
135.807 


Хо 

7.879 
10.597 
12.838 
14.860 
16.750 
18.548 
20.278 
21.955 
23.589 
25.188 
26.757 
28.300 
29.819 
31.319 
32.801 
34.267 
35.718 
37.156 
38.582 
39.997 
41.401 
42.796 
44.181 
45.558 
46.928 
48.290 
49.645 
50.993 
52.336 
53.672 


60.275 
66.766 
73.166 
79.490 
91.952 
104.215 
116.321 
128.299 
140.169 
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TABLE С Percentiles of the F Distribution 


0 4.04 Рә, 19 
pl Fo, 19 < 4.04) = .995 


Е 905 
Denominator N D f Freed 
Degrees of umerator Degrees of Freedom 


Freedom 1 2 3 4 5 6 7 8 9 


16211 20000 21615 22500 23056 23437 23715 23925 24091 
198.5 199.0 199.2 199.2 199.3 199.3 199.4 199.4 199.4 
55.55 49.80 47.47 46.19 45.39 44.84 44.43 44.13 43.88 
31.33 26.28 24.26 29.15 22.46 21.97 21.62 21.35 21.14 


I 
2 
3 
4 
5 22.78 18.31 16.53 15.56 14.94 14.51 14.20 13.96 13.77 
6 18.63 14.54 12.92 12.03 11.46 11.07 10.79 10.57 10.39 
7 16.24 12.40 10.88 10.05 9.52 9.16 8.89 8.68 8.51 
8 
9 


14.69 11.04 9.60 8.81 8.30 7.95 7.69 7.50 7.34 

13.61 10.11 8.72 7.96 7.47 7.13 6.88 6.69 6.54 

10 12.83 9.43 8.08 7.34 6.87 6.54 6.30 6.12 5.97 
11 12.23 8.91 7.60 6.88 6.42 6.10 5.86 5.68 5.54 
12 11.75 8.51 7.23 6.52 6.07 5.76 5.52 5.35 5.20 
13 11.37 8.19 6.93 6.23 5.79 5.48 5.25 5.08 4.94 
14. 11.06 7.92 6.68 6.00 5.56 5.26 5.03 4.86 4.72 
15 10.80 7.70 6.48 5.80 5.37 5.07 4.85 4.67 4.54 
16 10.58 7.51 6.30 5.64 5.21 4.91 4.69 4.52 4.38 
17 10.38 7.35 6.16 5.50 5.07 4.78 4.56 4.39 4.25 
18 10.22 7.21 6.03 5.37 4.96 4.66 4.44 4.28 4.14 
19 10.07 7.09 5.92 5.27 4.85 4.56 4.34 4.18 4.04 
20 9.94 6.99 5.82 5.17 4.76 4.47 4.26 4.09 3.96 
21 9.83 6.89 5.73 5.09 4.68 4.39 4.18 4.01 3.88 
22 9.73 6.81 5.65 5.02 4.61 4.32 4.11 3.94 3.81 
23 9.63 6.73 5.58 4.95 4.54 4.26 4.05 3.88 3.75 
24 9.55 6.66 5.52 4.89 4.49 4.20 3.99 3.83 3.69 
25 9.48 6.60 5.46 4.84 4.43 4.15 3.94 3.78 3.64 
26 9.41 6.54 5.41 4.79 4.38 4.10 3.89 3.73 3.60 
27 9.34 6.49 5.36 4.74 4.34 4.06 3.85 3.69 3.56 
28 9.28 6.44 5.32 4.70 4.30 4.02 3.81 3.65 3.52 
29 9.23 6.40 5.28 4.66 4.26 3.98 3.77 3.61 3.48 
30 9.18 6.35 5.24 4.62 4.23 3.95 3.74 3.58 3.45 
40 8.83 6.07 4.98 4.37 3.99 3.71 3.51 3.35 3:02 
60 8.49 5.79 4.73 4.14 3.76 3.49 3.29 3.13 3.01 
120 8.18 5.54 4.50 3.92 3.55 3.28 3.09 2.93 2.81 


oo 7.88 5.30 4.28 3.72 3.35 3.09 2.90 2.74 2.62 
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TABLE G (continued) 


зан Numerator Degrees of Freedom 
Freedom 10 12 15 20 24 30 40 60 120 © 
1 24224 24426 24630 24836 24940 25044 25148 25253 25359 25465 
2 199.4 1994 1994 1994 1995 199.5 1995 1995 1995 199.5 
3 43.69 43.39 43.08 42.78 4262 4247 42.31 42.15 41.99 41.83 
4 20.97 20.70 20.44 20.17 20.00 19.89 19.75 19.61 1947 19.32 
5 13.62 13.38 13.15 | 12.90 12.78 12.66 12.53 12.40 12.27 12.14 
6 10.25 10.03 9.81 9.59 9.47 9.36 9.24 9.12 9.00 8.88 
7 8.38 8.18 7.97 7.75 7.65 7.53 7.42 7.31 7.19 7.08 
8 7.21 7.01 6.81 6.61 6.50 6.40 6.29 6.18 6.06 5.95 
9 6.42 6.23 6.03 5.83 5.73 5.62 5.52 5.41 5.30 5.19 
10 5.85 5.66 5.47 5.27 5.17 5.07 4.97 4.86 4.75 4.64 
11 5.42 5.24 5.05 4.86 4.76 4.65 4.55 4.44 4.34 4.23 
12 5.09 4.91 4.72 4.53 4.43 4.33 4.23 4.12 4.01 3.90 
13 4.82 4.64 4.46 4.27 4.17 4.07 3.97 3.87 3.76 3.65 
14 4.60 4.43 4.25 4.06 3.96 3.86 3.76 3.66 3.55 344 
15 4.42 4.25 4.07 3.88 3.79 3.69 3.58 3.48 3.37 3.26 
16 4.27 4.10 3.92 3.73 3.64 3.54 3.44 3.33 3.22 3.11 
17 4.14 3.97 3.79 3.61 3.51 3.41 3.31 3.21 3.10 2.98 
18 4.03 3.86 3.68 3.50 3.40 3.30 3.20 3.10 2.99 2.87 
19 3.93 3.76 3.59 3.40 3.31 3.21 3.11 3.00 2.89 2.78 
20 3.85 3.68 3.50 3.32 3.22 3.12 3.02 2.92 2.81 2.69 
21 3.77 3.60 3.43 3.24 3.15 3.05 2.95 2.84 2.73 2.61 
22 3.70 3.54 3.36 3.18 3.08 2.98 2.88 2.77 2.66 2.55 
23 3.64 3.47 3.30 3.12 3.02 2.92 2.82 2.71 2.60 2.48 
24 3.59 3.42 3.25 3.06 2.97 2.87 2.77 2.66 2.55 2.43 
25 3.54 3.37 3.20 3.01 2.92 2.82 2.72 2.61 2.50 2.38 
26 3.49 3.33 3:15 2.97 2.87 2.77 2.67 2.56 2.45 2.33 
27 3.45 3.28 3.11 2.93 2.83 2.73 2.63 2.52 2.41 2.29 
28 3.41 3.25 3.07 2.89 2.79 2.69 2.59 2.48 2.37 2.25 
29 3.38 3.21 3.04 2.86 2.76 2.66 2.56 2.45 2.33 2.21 
30 3.34 3.18 3.01 2.82 2.73 2.63 2.52 2.42 2.30 2.18 
40 3.12 2.95 2.78 2.60 2.50 2.40 2.30 2.18 2.06 1.93 
60 2.90 2.74 2.57 2.39 2.29 2.19 2.08 1.96 1.83 1.69 
120 2.71 2.54 2.37 2.19 2.09 1.98 1.87 1.75 1.61 1.43 


oo 2.52 2.36 2.19 2.00 1.90 1.79 1.67 1.53 1.36 1.00 
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TABLE G (continued) 


F 99 


eet. Numerator Degrees of Freedom 


Freedom 1 2 3 4 5 6 7 8 9 


1 4052 49995 5403 5625 5764 5859 5928 5981 6022 
2 98.50 99.00 99.17 99.25 99.30 99.33 99.36 99.37 99.39 
3 34.12 30.82 29.46 2871 28.24 27.91 2767 27.49 27.35 
4 21.20 18.00 16.69 15.98 15.52 15.21 14.98 14.80 14.66 
5 16.26 13.27 12.06 11.39 10.97 10.67 10.46 10.29 10.16 
6 13.75 10.92 9.78 9.15 8.75 8.47 8.26 8.10 7.98 
7 12.25 9.55 8.45 7.85 7.46 7.19 699 6.84 6.72 
8 11.26 8.65 7.59 7.01 6.63 6.37 6.18 6.03 5.91 
9 10.56 8.02 6.99 642 6.06 5.80 5.61 5.47 5.35 
10 10.04 7.56 6.55 5.99 5.64 539 5.20 5.06 4.94 
11 9.65 7.21 6.22 5.67 5.32 5.07 489 474 463 
12 9.33 6.93 5.95 5.41 5.06 4.82 4.64 4.50 | 4.39 
13 9.07 670 5.74 521 486 462 444 430 4.19 
14 8.86 6.51 5.56 | 5.04 469 446 428 414 4.03 
15 8.08 636 542 489 4.56 4.32 414 400 3.89 
16 8.53 6.23 5.29 4.77 444 4.20 4.03 3.89 3.78 
17 8.40 6.11 5.18 4.67 434 4.10 3.93 3.79 3.68 
18 8.29 6.01 5.09 458 4.25 4.01 3.84 3.71 3.60 
19 8.18 5.93 5.01 450 4.17 3.94 3.77 3.63 3.52 
20 8.10 5.85 4.94 443 4.10 3.87 3.70 3.56 346 
21 8.02 5.78 487 4.37 404 3.81 3.64 3.51 3.40 
22 7.95 5.72 482 4.31 3.99 376 3.59 3.45 3.35 
23 7.88 5.60 4.76 426 3.94 | 3.71 3.54 3.41 3.30 
24 7.82 5.61 472 422 3.90 3.67 3.50 3.36 3.26 
25 7.77 5.57 4.68 418 3.85 3.63 3.46 332 3.22 
26 7.72 5.53 464 4.14 382 3.59 342 3.29 3.18 
27 7.68 549 4.60 4.11 3.78 3.56 3.39 3.26 3.15 
28 7.64 545 457 4.07 3:/5; 19:93 3.36 3.23 3.12 
29 7.60 542 454 4.04 3.73 3.50 3.33 3.20 3.09 
30 7.56 5.39 4.51 402 3.70 3.47 3.30 3.17 3.07 
40 7.31 5.18 431 3.83 3.51 3.29 3.12 2.989 2.89 
60 7.08 498 4.13 3.65 3.34 3.12 2.95 2.82 2.72 
120 6.85 4.79 3.95 3.48 3.17 2.96 2.79 2.66 2.56 


со 6.63 4.61 3.18 3.32 3.02 2.80 2.64 2.51 2.41 
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TABLE G (continued) 


D inat 
анна Numerator Degrees of Freedom 


Freedom 10 12 15 20 24 30 40 60 120 © 


1 6056 6106 6157 6209 6235 6261 6287 6313 6339 6366 
2 99.40 9942 9943 9945 99.46 99.47 99.47 99.48 99.49 99.50 
3 27.23 27.05 26.87 26.69 26.60 26.50 26.41 26.32 26.22 26.13 
4 14.55 14.37 14.20 14.02 13.93 13.84 13.75 13.65 13.56 13.46 
5 10.05 9.89 9.72 955 9.47 9.38 9.29 9.20 9.11 9.02 
6 7.87 7.72 7.56 740 7.31 7.23 7.14 7.06 6.97 6.88 
7 6.62 647 6.31 6.16 6.07 5.99 5.91 5.82 5.74 5.65 
8 5.81 567 5.52 536 5.28 5.20 5.12 5.03 4.95 4.86 
9 5.26 5.11 496 4.81 4.73 4.65 457 448 440 4.31 
10 485 471 456 441 433 4.25 4.17 4.08 400 3.91 
11 4.54 4.40 425 4.10 402 3.94 3.86 3.78 3.69 3.60 
12 4.30 4.16 4.01 386 3.78 3.70 362 3.54 3.45 3.36 
13 4.10 3.96 3.82 3.66 3.59 3.51 3.43 3.34 325 3.17 
14 3.94 3.80 3.66 3.51 3.43 3.35 3.27 3.18 3.09 3.00 
15 3.80 3.67 3.52 3.37 3.29 3.21 3.13 3.05 2.96 2.87 
16 3.69 3.55 3.41 3.26 3.18 3.10 3.02 2.93 2.84 2.75 
17 3.59 3.46 3.31 3.16 3.08 3.00 2.92 2.83 2.75 2.65 
18 3.51 3.37 3.23 3.08 3.00 2.92 2.84 2.75 2.66 2.57 
19 3.43 3.30 3.15 3.00 2.92 2.84 2.76 2.67 2.58 2.49 
20 3.37 3.23 3.09 2.94 2.86 2.78 2.69 2.61 2.52 2.42 
21 3.31 3.17 3.03 2.88 2.80 2.72 2.64 2.55 2.46 2.36 
22 3.26 3.12 2.98 2.83 2.75 2.67 2.58 2.50 2.40 2.31 
23 3.21 3.07 2.93 2.78 2.70 2.62 2.54 2.45 2.35 2.26 
24 3.17 3.03 2.89 2.74 2.66 258 249 240 231 2.21 
25 3.13 2.99 2.85 2.70 2.62 2.54 2.45 2.36 2.27 2.17 
26 3.09 2.96 2.81 2.66 2.58 2.50 2.42 2.33 2.23 2.13 
27 3.06 2.93 2.78 2.63 2.55 2.47 2.38 2.29 2.20 2.10 
28 3.03 2.90 2.75 2.60 2.52 2.44 2.35 2.26 2.17 2.06 
29 3.00 2.87 2.73 2.57 2.49 2.41 2.33 2.23 2.14 2.03 
30 2.98 2.84 2.70 2.55 247 2.39 2.30 221 211 2.01 
40 2.80 2.66 2.52 2.37 2.29 2.20 2.11 2.02 1.92 1.80 
60 2.63 2.50 2.35 2.20 2.12 2.03 1.94 1.84 1.73 1.60 
120 2.47 2.34 2.19 2.00 195 1.86 1.76 1.66 1.53 1.38 


E 2.32 2.18 2:04 188 179 1.70 1.59 147 1.32 1.00 
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TABLE G (continued) 


F .975 


posar Numerator Degrees of Freedom 


Freedom 1 2 3 4 5 6 7 8 9 


I 647.8 7995 8642 899.6 921.8 937.1 948.2 9567 963.3 
2 38.51 39.00 39.17 39.25 39.30 39.33 39.36 39.37 39.39 
3 17.44 1604 15.44 15.10 14.88 14.73 14.62 14.54 14.47 
4 12.22 10.65 9.98 9.60 9.36 9.20 9.07 8.98 8.90 
5 10.01 8.43 7.76 | 7.39 7.15 6.98 6.85 676 6.68 
6 8.81 7.26 6.60 6.23 5.99 5.82 5.70 5.60 5.52 
7 8.07 6.54 5.89 552 5.29 5.12 499 4.90 4.82 
8 7.57 6.06 542 5.05 482 465 453 443 4.36 
9 7.21 5.71 5.08 4.72 448 432 4.20 4.10 4.03 
10 6.94 54 483 4.47 424 4.07 395 3.85 3.78 
11 6.72 5.26 4.63 4.28 4.04 3.88 376 3.66 3.59 
12 6.55 5.10 447 4.12 3.89 3.73 3.61 3.51 3.44 
13 6.41 497 4.35 4.00 3.77 3.60 3.48 3.39 3.31 
14 6.30 486 4.24 3.89 3.66 3.50 3.38 3.29 3.21 
15 620 477 415 3.80 3.58 3.41 3.29 320 3.12 
16 6.12 4.69 408 3.73 3.50 3.34 322 3.12 3.05 
17 6.04 4.62 4.01 3.66 344 3.28 3.16 3.06 2.98 
18 5.98 4.56 3.95 3.61 3.38 3.22 3.10 3.01 2.93 
19 5.92 4.51 3.90 3.56 3.33 3.17 3.05 2.96 2.88 
20 5.87 446 3.86 3.51 $:29° 3:13; 3:01 2.91 2.84 
21 5.83 4.42 3.82 348 3.25 3.09 2.97 2.87 2.80 
22 5.79 4.38 3.78 344 3.22 3.05 2.93 2.84 2.76 
23 5.75 4.35 3.75 3.41 3.18 3.02 2.90 2.81 2.73 
24 9.72 432 3.72 838 3.15 2.99 287 2.78 2.70 
25 5.69 429 3.69 3.35 3.13 297 2.85 2.75 268 
26 5.66 427 3.67 3.33 3.10 2.94 282 2.73 2.65 
27 5.63 424 3.65 3.31 3.08 2.92 280 2.71 2.63 
28 5.61 4.22 3.63 3.29 3.06 2.90 2.78 2.69 2.61 
29 5.59 420 3.61 3.27 3.04 288 276 2.67 2.59 
30 5.57 4.18 3.59 3.25 3.03 287 275 2.65 257 
40 5.42 405 3.46 3.13 2.90 274 2.62 2.53 245 
60 5.29 3.93 3.34 3.01 2.79 2.63 | 2.51 2.41 2.33 
120 5.15 3.80 3.23 289 267 2.52 2.39 230 222 


со 5.02 3.69 | 3.12 279 257 241 2.29 2.19 2.11 
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TABLE G (continued) 


D inat 
Darant Numerator Degrees of Freedom 


Freedom 10 12 15 20 24 30 40 60 120 © 


1 968.6 976.7 9849 993.1 9972 1001 10066 1010 1014 1018 
2 39.40 3941 39.43 3945 3946 3946 3947 3948 3949 39.50 
3 14.42 14.34 14.25 14.17 14.12 14.08 14.04 13.99 13.95 13.90 
4 8.84 8.75 8.66 8.56 8.51 8.46 8.41 8.36 8.31 8.26 
5 6.62 6.52 643 633 6.28 623 6.18 6.12 607 6.02 
6 5.46 5.37 5.27 5.17 5.12 5.07 5.01 496 4.90 | 4.85 
7 4.76 4.67 4.57 447 442 4.36 4.31 4.25 4.20 414 
8 4.30 4.20 4.10 4.00 3.95 3.89 3.84 3.78 3.73 3.67 
9 3.96 3.87 3.77 3.67 3.61 3.56 3.51 345 3.39 333 
10 3.72 3.62 3.52 3.42 3.37 3.31 3.26 3.20 3.14 3.08 
11 3.53 3.43 3.33 323 3.17 3.12 3.06 3.00 2.94 2.88 
12 3.37 3.28 3.8 3.07 3.02 2.96 2.91 2.85 2.79 2.72 
13 3.25 3.15 3.05 2.95 2.89 2.84 2.78 2.72 266 2.60 
14 3.15 3.05 2.95 2.84 2.79 2.73 267 261 255 249 
15 3.06 2.96 2.86 2.76 2.70 2.64 2.59 2.52 244 240 
16 2.99 2.89 2.79 2.68 2.63 2.57 2.51 2.45 2.38 2.32 
17 2.92 2.82 2.72 2.62 2.56 2.50 2.44 2.38 232 225 
18 2.87 2.77 2.67 2.56 2.50 2.44 2.38 2.32 2.26 2.19 
19 2.82 2.72 2.62 2.51 2.45 2.39 2.33 2.27 2.20 2.13 
20 2.77 2.68 2.57 2.46 241 2.35 2.29 2.22 2.16 2.09 
21 2.13: 2,04 253 242 237 .231 225 218: ZH 2.04 
22 2.70 2.60 2.50 2.39 2.33 2.27 221 2.14 2.08 2.00 
23 2.67 2.57 2.47 2.36 2.30 2.24 2.18 2.11 2.04 1.97 
24 2.64 2.54 244 2.33 227 2.21 2.15 2.08 2.01 1.94 
25 2.61 2.51 2.41 2.30 2.24 2.18 212 2.05 1.98 1.91 
26 2.59 2.49 2.39 2.28 2.22 2.16 2.09 2.03 1.95 1.88 
27 2.57 2.47 2.36 225 2.19 2.13 2.07 2.00 1.93 1.85 
28 2.55 245 2.34 2.23 2.17 211 2.05 1.98 1.91 1.83 
29 2.53 2.43 2.32 2.21 2.15 2.09 2.03 1.96 1.89 1.81 
30 251 241 231 220 214 207 2901 1.94 1.87 1.79 
40 2.39 2.29 2.18 2.07 2.01 1.94 1.88 1.80 — 1.72 1.64 
60 2.27 2.17 2.06 1.94 1.88 1.82 1.74 1.67 1.58 1.48 
120 2.16 2.05 1.94 1.82 1.76 1.69 1.61 1.53 1.43 1.31 


о 2.05 1.94 1.83 1.71 1.64 1.57 1.48 1.39 1.27 1.00 
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TABLE G (continued) 


F 95 


D inat 
Degrees of Numerator Degrees of Freedom 


Freedom 1 2 3 4 5 6 7 8 9 


1 1614 1995 2157 2246 2302 2340 2368 2389 240.5 
2 18.51 19.00 19.16 19.25 19.30 19.33 19.35 19.37 19.38 
3 10.13 9:55 9.28 9.12 9.01 8.94 889 8.85 8.81 
4 7.71 6.94 6.59 6.39 6.26 6.16 6.09 6.04 | 6.00 
5 6.61 5.79 5.41 5.19 5.05 4.95 4.88 482 477 
6 5.99 5.14 476 4.53 439 4.28 4.21 415 4.10 
7 5.59 4.74 435 412 3.97 3.87 3.79 3.73 3.68 
8 5.32 446 4.07 3.84 3.69 3.58 3.50 3.44 3.39 
9 5.12 4.26 3.86 3.63 3.48 3.37 3.29 3.23 318 
10 496 4.10 3.71 3.48 3.33 3.22 3.14 3.07 3.02 
11 4.84 3.98 3.59 3.36 320 3.09 3.01 2.95 2.90 
12 4.75 389 349 3.26 3.11 3.00 2.91 2.85 2.80 
13 467 3.81 3.41 3.18 3.00 292 2.83 277 271 
14 460 3.74 3.34 3.11 296 285 276 270 2.65 
15 4.54 3.68 329 3.06 290 2.79 2.71 2.64 2.59 
16 449 3.60 3.24 3.01 285 2.74 26 2.59 2.54 
17 445 3.59 320 2.96 281 2.0 2.61 2.55 2.49 
18 4.41 3.55 3.16 293 2.77 2.66 2.58 | 2.51 2.46 
19 438 3.52 3.13 2.90 2.74 2.63 254 248 2.42 
20 4.35 349 3.10 287 2.71 2.60 2.51 2.45 2.39 
21 432 3.47 3.07 284 268 2.57 249 242 237 
22 4.30 344 305 2.82 26 2.55 246 240 2.34 
23 428 3.42 3.03 2.80 2.64 2.53 244 237 2.32 
24 4.26 3.40 3.01 2.78 2.62 2.51 2.42 2.36 2.30 
25 4.24 3.39 299 2.76 260 249 240 2.34 2.28 
26 4.23 3.37 2.98 2.74 2.59 247 2.39 2.32 2.27 
27 4.21 3.35 2.96 2.73 257 246 2.37 2.31 2.25 
28 420 3.34 2.95 2.71 2.56 2.45 2.36 2.29 2.24 
29 4.18 3.33 293 2.70 255 243 235 2.28 2.22 
30 417 332 292 269 253 242 233 2.27 2.21 
40 4.08 3.23 284 2.61 245 2.34 225 2.18 2.12 
60 400 3.15 2.76 253 2.37 2.25 2.17 2.10 2.04 
120 3.92 3.07 268 245 2.29 217 209 2.02 1.96 


© 3.84 3.00 260 2.37 221 2.10 2.01 1.94 1.88 
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TABLE G (continued) 


D inat 
Пеана Numerator Degrees of Freedom 


Freedom 10 12 15 20 24 30 40 60 120 © 


1 241.9 243.9 245.9 248.0 2491 250.1 251.1 252.2 253.3 254.3 
2 19.40 19.41 19.43 19.45 19.45 19.46 19.47 19.48 19.49 19.50 
3 8.79 8.74 8.70 8.66 864 862 859 8.57 8.55 8.53 
4 5.96 591 5.86 5.80 577 5.75 5.72 569 566 5.63 
5 474 4.68 462 456 4.53 450 446 443 440 4.36 
6 406 4.00 3.94 3.87 3.84 3.81 3.77 3.14 3.70 367 
7 3.64 3.57 3.51 3.44 341 3.38 3.34 3.30 3.27 3.23 
8 3.35 3.28 3.22 3.15 3.12 3.08 3.04 3.01 2.97 2.93 
9 3.14 3.07 3.01 2.94 2.90 2.86 2.83 2.79 2.75 2.71 
10 2.98 2.91 2.85 2.77 2.14 2.10 2.66 2.62 2.58 2.54 
11 2.85 279 272 265 261 257 253 249 245 240 
12 275 2.69 262 254 251 247 243 238 234 230 
13 2.07 2.60 253 244 242 238 234 230 225 2.21 
14 2.60 253 246 239 235 231 227 222 2.18 2.13 
15 2.54 248 240 233 229 225 2.20 2.16 211 2.07 
16 249 242 235 228 224 2.19 215 211 206 2.01 
17 245 238 231 223 219 2.15 210 206 201 1.96 
18 241 234 227 219 215 211 206 202 197 1.92 
19 2.38 2.31 2.23 2.16 211 207 2.03 198 1.93 1.88 
20 2.35 2.28 2.20 2.12 2.08 2.04 1.99 1.95 1.90 184 
21 2.32 2.25 2.18 2.10 205 201 1.96 1.92 1.87 1.81 
22 230 2.23 2.15 2.07 2.03 1.98 1.94 189 1.84 1.78 
23 227 2.20 2.13 2.05 201 1.96 1.91 1.86 1.81 1.76 
24 2.25 2.18 2.11 2.03 1.98 1.94 189 1.84 179 1.73 
25 2.24 2.16 2.09 2.01 1.96 1.92 1.87 182 1.77 171 
26 2.22 2.15 2.07 1.99 1.95 1.90 1.85 180 175 1.69 
27 2.20 2.13 2.06 1.97 1.93 1.88 1.84 1.79 1.73 1.67 
28 2.19 2.12 2.04 1.96 1.91 1.87 1.82 1.77 171 1.65 
29 2.18 2.10 2.03 1.94 1.90 1.85 1.81 1.75 1.70 1.64 
30 2.16 2.09 2.01 1.93 1.89 1.84 1.79 1.74 1.68 1.62 
40 2.08 2.00 192 1.84 1.79 1.74 1.69 164 158 1.51 
60 1.99 1.92 1.84 1.75 1.70 1.65 1.59 1.53 147 1.39 
120 1.91 1.83 1.75 1.66 161 1.55 1.50 1.43 1.35 1.25 


© 1.3 1.75 167 1.57 152 144 139 132 122 1.00 


a 
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TABLE G (continued) 


Denominator 
Degrees of 
Freedom 


DOI олым ~ 


Е 9 


Numerator Degrees of Freedom 


3 


53.59 
9.16 
5.39 
4.19 
3.62 


3.29 
3.07 
2.92 
2.81 


2.73 
2.66 
2.61 
2.56 
2.52 


2.49 
2.46 
2.44 
2.42 
2.40 


2.38 
2.36 
2.35 
2.34 
2.33 


2.32 
2.31 
2.30 
2.29 
2.28 


2.28 
2.23 
2.18 
2.13 
2.08 


4 


55.83 
9.24 
5.34 
4.11 
3.52 


3.18 
2.96 
2.81 
2.69 


2.61 
2.54 
2.48 
2.43 
2.39 


2.36 
2.33 
2.31 
2.29 
2.27 


2.25 
2.23 
2.22 
2.21 
2.19 


2.18 
2.17 


5 


57.24 
9.29 
5.31 
4.05 
3.45 


3.11 
2.88 
2.73 
2.61 


2.52 
2.45 
2.39 
2.35 
2.31 


2.27 
2.24 
2.22 
2.20 
2.18 


2.16 
2.14 
2.13 
2.11 
2.10 


2.09 
2.08 
2.07 
2.06 
2.06 


2.05 
2.00 
1.95 
1.90 
1.85 


6 


58.20 
9.33 
5.28 
4.01 
3.40 


3.05 
2.83 
2.67 
2.55 


2.46 
2.39 
2.33 
2.28 
2.24 


2.21 
2.18 
2.15 
2.13 
2.11 


2.09 
2.08 
2.06 
2.05 
2.04 


2.02 
2.01 
2.00 
2.00 
1.99 


1.98 
1.93 
1.87 
1.82 
1.77 


7 


58.91 
9.35 
5.27 
3.98 
3.37 


3.01 
2.78 
2.62 
2.51 


2.41 
2.34 
2.28 
2.23 
2.19 


2.16 
2.13 
2.10 
2.08 
2.06 


2.04 
2.02 
2.01 
1.99 
1.98 


1.97 
1.96 
1.95 
1.94 
1.93 


1.93 
1.87 
1.82 
1.77 
1.72 
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TABLE G (continued) 


D inat 
Dep. Numerator Degrees of Freedom 


Freedom 10 12 15 20 24 30 40 60 120 © 


1 60.19 60.71 61.22 61.74 62.00 62.26 62.53 62.79 63.06 63.33 

2 939 9.4] 942 944 945 946 947 947 948 949 
3 5.23 5.22 5.20 5.18 5.18 5.17 5.16 5.15 5.14 5.13 
4 3.92 3.90 3.87 3.84 3.83 3.82 3.80 3.79 3.8 3.76 
5 3.30 3.27 3.24 3.21 3.19 3.7 3.16 3.14 3.12 3.10 
6 2.94 2.90 287 2.84 282 280 278 276 274 272 
7 2.70 2.67 2.63 259 2.58 2.56 2.54 251 249 247 
8 2.54 2.50 2.46 2.42 2.40 2.38 2.36 2.34 2.32 2.29 
9 2.42 2.38 2.34 2.30 2.28 2.25 2.23 2.21 2.18 2.16 
10 2.32 2.28 2.24 2.20 2.18 2.16 2.13 2.11 2.08 2.06 
п 2.25 221 2.17 2.12 2.10 2.08 2.05 2.03 2.00 1.97 
12 2.19 2.15 2.10 2.06 2.04 2.01 1.99 1.96 1.93 1.90 
13 2.14 2.10 2.05 2.01 1.98 1.96 1.93 1.90 1.88 1.85 
14 2.10 2.05 2.01 1.96 1.94 1.91 1.89 1.86 1.83 1.80 
15 2.06 2.02 1.97 1.92 190 1.87 1.85 1.82 1.79 1.76 
16 2.03 1.99 1.94 189 1.87 1.84 1.81 1.78 175 172 
17 2.00 1.96 1.91 186 1.84 1.81 178 1.75 1.72 1.69 
18 1.98 1.93 189 1.84 1.81 1.78 1.75 172 1.69 1.66 
19 196 1.91 1.86 1.81 1.79 1.76 1.73 1.70 1.67 1.63 
20 1.94 189 1.84 1.79 1.77 1.74 1.71 168 1.64 1.61 
21 1.92 1.87 1.83 1.78 1.75 1.72 1.69 1.66 1.62 1.59 
22 1.90 1.86 1.81 1.76 1.73 1.70 1.67 1.64 1.60 1.57 
23 1.89 1.84 1.80 1.74 1.72 1.69 1.66 1.62 1.59 1.55 
24 1.88 1.83 1.78 1.73 1.70 1.67 1.64 1.61 1.57 1.53 
25 1.87 1.82 1.77 1.72 169 1.66 1.63 1.59 1.56 1.52 
26 1.86 1.81 1.76 1.71 1.68 1.65 1.61 1.58 1.54 1.50 
27 1.85 1.80 1.75 1.70 1.67 1.64 1.60 1.57 1.53 1.49 
28 1.84 1.79 1.74 1.69 1.66 1.63 1.59 1.56 1.52 1.48 
29 1.83 1.78 1.73 1.68 1.65 1.62 1.58 1.55 1.51 1.47 
30 1.82 1.77 1.72 1.67 1.64 1.61 1.57 1.54 1.50 1.46 
40 1.76 1.71 1.66 1.61 1.57 1.54 1.51 1.47 1.42 1.38 
60 1.71 1.66 1.60 1.54 1.51 1.48 1.44 1.40 1.35 1.29 
120 1.65 1.60 1.55 1.48 1.45 1.41 1.37 1.32 1.26 1.19 


oo 1.60 1.55 149 142 138 134 130 124 1.17 1.00 
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TABLE H Percentage Points of the Studentized Range for 2 Through 20 Treatments 
Upper 5% Points 


TABLE Н (continued) 


SODIO ифом ~ 


Dyer 
оомо QU -UMWN- 


C ь ш г 
ооо + 


120 


135.0 
19.02 
10.62 
8.12 
6.98 


6.33 
5.92 
5.64 
5.43 
5.27 


5.15 
5.05 
4.96 
4.89 
4.84 


4.79 
4.74 
4.70 
4.67 
4.64 


4.55 
4.45 
4.37 
4.28 
4.20 
4.12 


164.3 
22.29 
12.17 
9.17 
7.80 


7.03 
6.54 
6.20 
5.96 
5.77 


5.62 
5.50 
5.40 
5.32 
5.25 


5.19 
5.14 
5.09 
5.05 
5.02 


4.91 
4.80 
4.70 
4.59 
4.50 
4.40 


185.6 
24.72 
13.33 
9.96 
8.42 


7.56 
7.01 
6.62 
6.35 
6.14 


5.97 
5.84 
5.73 
5.63 
5.56 


5.49 
5.43 
5.38 
5.33 
5.29 


5.17 
5.05 
4.93 
4.82 
4.71 
4.60 
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202.2 
26.63 
14.24 
10.58 

8.91 


7.97 
7.37 
6.96 
6.66 
6.43 


6.25 
6.10 
5.98 
5.88 
5.80 


5.72 
5.66 
5.60 
5.55 
5.51 


5.37 
5.24 
5.11 
4.99 
4.87 
4.76 


215.8 
28.20 
15.00 
11.10 

9.32 


8.32 
7.68 
7.24 
6.91 
6.67 


6.48 
6.32 
6.19 
6.08 
5.99 


5.92 
5.85 
5.79 
5.73 
5.69 


5.54 
5.40 
5.26 
5.13 
5.01 
4.88 


227.2 
29.53 
15.64 
11.55 

9.67 


8.61 
7.94 
7.47 
7.13 
6.87 


6.67 
6.51 
6.37 
6.26 
6.16 


6.08 
6.01 
5.94 
5.89 
5.84 


5.69 
5.54 
5.39 
5.25 
5.12 
4.99 


237.0 
30.68 
16,20 
11.93 

9.97 


8.87 
8.17 
7.68 
7:33 
7.05 


6.84 
6.67 
6.53 
6.41 
6.31 


6.22 
6.15 
6.08 
6.02 
5.97 


5.81 
5.65 
5.50 
5.36 
5.21 
5.08 
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245.6 
31.69 
16.69 
12,27 
10.24 


9.10 
8.37 
7.86 
7.49 
7.21 


6.99 
6.81 
6.67 
6.54 
6.44 


6.35 
6.27 
6.20 
6.14 
6.09 


5.92 
5.76 
5.60 
5.45 
5.30 
5.16 
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TABLE Н (continued) 


294.3 


1 253.2 260.0 2662 271.8 2770 2818 2863 290.4 298.0 
2 32.59 33.40 34.13 34.81 35.43 36.00 36.53 37.03 37.50 37.95 
3 17.13 17.53 17.89 18.22 18.52 18.81 19.07 19.32 19.55 19.77 
4 12.57 12.84 13.09 13.32 13.53 13.73 13.91 14.08 14.24 14.40 
5 10.48 10.70 10.89 11.08 11.24 11.40 11.55 11.68 11.81 11.93 
6 9.30 9.48 9.65 9.81 9.95 10.08 10.21 10.32 10.43 10.54 
7 8.55 8.71 8.86 9.00 9.12 9.24 9.35 9.46 9.55 9.65 
8 8.03 8.18 8.31 8.44 8.55 8.66 8.76 8.85 8.94 9.03 
9 7.65 7.78 7.91 8.03 8.13 8.23 8.33 8.41 8.49 8.57 
10 7.36 7.49 7.60 7.71 7.81 7.91 7.99 8.08 8.15 8.23 
11 7.13 7.25 7.36 7.46 7.56 7.65 7.73 7.81 7.88 7.95 
12 6.94 7.06 7.17 7.26 7.36 7.44 7.52 7:39 7.66 7.73 
13 6.79 6.90 7.01 7.10 7.19 71,27 7.35 7.42 7.48 7.55 
14 6.66 6.77 6.87 6.96 7.05 7.13 7.20 7.27 1:33 7.39 
15 6.55 6.66 6.76 684 6.93 7.00 7.07 7.14 7.20 7.26 
16 6.46 656 6.60 6.74 6.82 6.90 6.97 7.03 7.09 7.19 
17 6.38 648 6.57 6.66 6.73 6.81 6.87 6.94 7.00 7.05 
18 6.31 6.41 6.50 6.58 6.65 6.73 6.79 6.85 6.91 6.97 
19 6.25 6.34 643 6.51 6.58 6.65 6.72 6.78 6.84 6.89 
20 6.19 6.28 6.37 6.45 6.52 6.59 6.65 6.71 6.77 6.82 
24 6.02 6.11 6.19 6.26 6.33 6.39 6.45 6.51 6.56 6.61 
30 5.85 5.93 6.01 6.08 6.14 6.20 6.26 6.31 6.36 6.41 
40 5.69 576 5.83 590 5.96 6.02 6.07 6.12 6.16 6.21 
60 5.53 5.60 5.67 5.73 5.78 5.84 5.89 5.93 5.97 6.01 
120 5.37 5.44 5.50 5.56 5.61 5.66 5.71 5.75 5.79 


5.40 5.61 


TABLE | Transformation of r to z (the Body of the Table Contains Values of 
z = .5[In(1 + r)/(1 - 0)] = tanh^'r for Corresponding Values of г, the Correlation 
Coefficient) 


.00 .01 02 .03 .04 .05 .06 07 .08 .09 


r 
0 .00000 .01000 .02000 .03001 .04002 .05004 .06007 .07012 .08017 .09024 
1 .10034 .11045 .12058 .13074 .14093 .15114 .16139 .17167 .18198 .19234 
2 .20273 .21317 .22366 .23419 .24477 .25541 .26611 .27686 .28768  .29857 
З .30952 32055 33165 .34283 .35409 .36544 .37689 .38842 .40006 .41180 

4 .42365 43561 .44769 .45990 .47223 .48470 .49731 .51007 .52298 .53606 

5 

6 

7 

8 

9 


.94931  .56273 .57634 .59014 .60415 .61838 .63283 .64752 .66246 .67767 
.69315 .70892 .72500 .74142 .75817 .77530 79281 .81074 .82911 .84795 
.86730 .88718 .90764 .92873 .95048 .97295 .99621 1.02033 1.04537 1.07143 
1.09861 1.12703 1.15682 1.18813 1.22117 1.25615 1.29334 1.33308 1.37577 1.42192 
1.47222 1.52752 1.58902 1.65839 1.73805 1.83178 1.94591 2.09229 2.29756 2.64665 
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TABLE J Significance Tests in a 2 x 2 Contingency Table? 


Probability 
a 0.05 0.025 0.01 0.005 
A = 3 B эз 3 3 0 050 — — — 
A=4B=4 4 0514 0014 == = 
3 4 029 — = = 
A=5B=5 5 024 1.024 0 004 0 004 
4 024 0.024 = 
4 5 1.048 .008 0 оов — 
4 040 — — e 
3 5 0515 0 ов — — 
2 5 0 048 — — — 
A-6B-6 6 2 030 1.008 1.008 0 ooi 
5 Loso 0 оов 008 — 
4 030 — — — 
5 6 .015+ 1.015+ 0.002 0.002 
5 013 013 = = 
4 0457 end === 
4 6 1.033 0 005- 0 005- 0.005- 
5 024 024 — 
3 6 012 012 — — 
5 .048 = = = 
2 6 036 = === = 
A=7B=7 7 0357 2 010+ 1.002 1002 
6 0157 lois- 002 002 
5 .010* .010* == == 
4 0357 — Е = 
6 7 .021 2021 1.005- loos- 
6 1.025+ .004 004 004 
5 016 016 — — 
4 .049 — = — 
5 7 2 945* loio* UT 0001 
6 1.045+ 008 008 — 
5 027 = = = 
4 7 1.024 1.024 0 ооз 0 ооз 
6 .015* .015+ E — 
5 045+ = — — 
3 7 0 оов 0 оов 0 оов = 
6 033 — = = 
2 7 028 = = = 
А=8В=8 8 .038 3013 2 003 2.003 
7 .020 .020 1 005+ 0 оо 
6 .020 .020 003 0 ооз 
5 0515 013 == — 
4 0038 = — — 
A-8B-7 8 .026 2 007 2 007 looi 
7 2 935- 1009 1.009 0001 
6 .032 0 006 006 — 
5 019 0519 — = 
6 8 20157 20157 1.003 1.003 


“Bold type, for given а, A, and B, shows the value of b (< a), which is just significant at the probability 
level quoted (single-tail test). Small type, for given А, B, and r = a + b, shows the exact probability (if 
there is independence) that b is equal to or less than the integer shown in bold type. 


А-56 APPENDIX STATISTICAL TABLES 


TABLE J (continued) 


Probability 
a 0.05 0.025 
7 1.016 1016 
6 .009 009 
5 0028 — 
5 8 .035- 1.007 
7 032 0 005- 
6 016 0016 
5 044 == 
4 8 018 lois 
7 0010+ 0010+ 
6 030 — 
3 8 006 0 оов 
7 024 0.024 
2 8 022 0.022 
А = 9 В = 9 9 041 4 015- 
8 0257 3025- 
7 028 1 оов 
6 .025- 1.025- 
5 0157 0015- 
4 041 — 
8 9 029 3 009 
8 043 2013 
7 .044 loi? 
6 1.036 050; 
5 020 020 
7 9 019 3019 
8 024 2 024 
7 020 1.020 
6 отож 010* 
5 029 == 
6 9 044 2011 
8 047 loi 
7 0357 0006 
6 017 0017 
5 042 "E 
5 9 027 loos- 
8 023 1.023 
7 0010+ 0010+ 
6 028 — 
4 9 014 1014 
8 007 0.007 
7 0.021 0021 
6 049 — 
3 9 .045+ 0005- 
8 ИТ 0018 
7 045* "m 
2 9 018 0018 
A = 10 B = 10 10 043 5016 
9 4 929 0107 
- 30357 012 
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TABLE J (continued) 


Probability 
a 0.05 0.025 0.01 0.005 
6 1029 0005+ 0 005+ = 
5 016 0016 == — 
4 043 ics = == 
А = 108 = 9 10 .033 401 3 003 3 ооз 
9 4 507 3017 2 005- 0057 
8 019 2019 1.004 004 
7 .015- Lois- 002 0002 
6 .040 0 оов 0 оов Е 
5 0022 0 022 — мыш 
8 10 023 4 923 3 007 2 902 
9 3032 2 009 2 009 1 002 
8 031 1.008 1 оов 0001 
7 023 1.023 0 004 004 
6 оп 051 — = 
5 029 — — TE 
7 10 0157 3015- 2 003 2 003 
9 .018 2018 1 004 1.004 
8 .013 1.013 0.002 002 
7 036 0006 0006 == 
6 \017 0017 = — 
5 041 — == — 
6 10 036 2 008 2 008 looi 
9 036 1.008 1.008 001 
8 024 1.024 0003 0 ооз 
7 010+ 0010+ — = 
6 026 — = о 
5 10 022 2 022 1.004 1.004 
9 .017 1.017 0.002 0002 
8 047 0 007 007 — 
7 019 0019 — = 
6 042 = — Ies 
4 10 оп loi 0001 0001 
9 041 0 0057 0.005- 0 005- 
8 0157 0015- = = 
7 0857 — = 
3 10 038 0 ооз 0 ооз 0 ооз 
9 014 0514 — 
8 0357 => = = 
2 10 015+ Oo15+ — — 
9 045+ = == — 
A=11B=11 11 7 045+ бов 5 006 4 002 
10 5 032 4012 3.004 3.004 
9 040 3015- 2 004 2 004 
8 3045 2015- 1.004 1.004 
7 040 1.012 0.002 0002 
6 1.032 0 оов 006 = 
5 018 Opis = — 
4 045+ m <i = 
10 П 6 035+ 5012 4 004 4 004 
10 4021 4 021 3.007 2 002 
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TABLE J (continued) 


A=11B=8 


2 
A=12B=12 


— — — — — — — — — — a 
со ‹ос © — мз со о © омс ро OQ» м! Со «(D O — CO с» - Со (Oo © — 00000 оло моо 


— — 


— — 
оо – 


Probability 


0.025 


3.024 
2 923 
1017 
.009 
0.023 
4008 
3012 
2 012 
1.009 
1.025- 
012 
4018 
024 
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TABLE J (continued) 


Probability 
a 0.05 0.025 0.01 0.005 
7 2 945- 1.014 0.002 0 002 
6 1.034 0.007 0,50; — 
5 019 0019 — = 
4 0.047 — = — 
11 12 7 037 6014 5.005- 5 005- 
11 5 024 5.024 4 008 3.002 
10 4 029 3010+ 2 003 2 003 
030 009 2 009 002 
8 026 1 007 loo; 001 
7 019 1.019 0 ооз 0 ооз 
6 045- 0 oos 0 ооо = 
5 0024 0024 ыы — 
10 12 029 5010- 5010- 4 003 
11 043 015* 3.005- 3 005- 
10 4048 017 2 005- 2 0057 
9 046 015- 1.004 1.004 
8 038 Loio+ 0002 0.002 
7 026 0 005- 0005- 0057 
6 012 0.012 — = 
5 озо а= = — 
A=12B=9 12 5021 5021 4006 3 002 
п 029 .009 3.009 2 002 
10 029 2.008 2 008 1 002 
9 2 024 2 024 006 001 
8 1016 lois 002 0002 
7 .037 007 0.007 — 
6 017 017 — — 
5 .039 == = == 
8 12 .049 4014 3.004 3.004 
11 3018 018 2 004 2 004 
10 .015+ 2 015+ 1.003 1.003 
9 .040 0107 0107 0001 
8 1.025- .025- 004 004 
7 0010+ 010* == = 
6 02 .024 — = 
7 12 036 ‚009 3 009 2 002 
п 038 20107 20107 1 002 
10 029 .006 006 0 ooi 
9 1.017 1.017 002 002 
8 .040 007 0007 = 
7 0016 0016 zm: — 
6 034 == "s == 
6 12 0257 3.025- 2 005- 2 005- 
11 ‚022 2 022 1 004 1.004 
10 loi lois 0 002 0002 
9 032 0 005- 0.005- 0 005- 
8 оп 001 = = 
7 0257 0025- = — 
6 0507 == = = 
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TABLE J (continued) 


2 
А = 13 B = 13 


12 


A=13B=12 


11 


10 


Probability 


0.025 


loio- 

0 ооз 
009 

0.020 
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TABLE J (continued) 


Probability 
a 0.05 0.025 0.01 0.005 
7 1.038 0007 0007 — 
6 017 0017 = — 
5 0 озв = = — 
9 13 017 5017 4 005- 4 005- 
12 023 .023 007 001 
11 022 022 006 1.001 
10 2017 017 1.004 004 
9 .040 1.010+ 001 9001 
8 1.025- 1.025- 004 004 
7 010+ 0010+ E m 
6 023 023 — — 
5 0019 — — — 
8 13 5942 4012 3 ооз 3 003 
12 047 014 003 003 
11 041 "nm 1.002 1.002 
10 2 029 loo; loo; 00; 
9 1.017 1.017 002 002 
8 .037 0 006 006 = 
7 0157 0 015- = = 
6 032 = — — 
7 13 .031 3.007 3 007 2 001 
12 031 2 007 2 007 looi 
11 022 2 022 004 004 
10 loi; 1.012 0002 002 
9 1.029 0 004 0004 004 
8 ото 0010+ = = 
7 022 0.022 — == 
6 0044 — — — 
6 13 .021 3021 2 004 2 004 
12 017 2017 1.003 1.003 
11 .046 Loio- 1o10- 0o01 
10 1.024 1.024 003 0 ооз 
9 loso- 0 оов 008 — 
8 017 017 — — 
7 034 — — 8 
5 13 012 2012 1.002 1.002 
12 .044 1.008 1.008 0 оо 
11 1.022 1.022 0 оо2 002 
10 047 0007 0007 — 
9 0157 0157 — = 
8 029 == = = 
A=13B=4 13 2 044 1 006 1 006 0 ооо 
12 1 022 022 0.002 0.002 
11 006 0 006 0 оов = 
10 0015- 0o15- = = 
9 029 = = 
3 13 025 1.025 0002 0002 
12 007 0007 0 007 
11 Оов 0018 == orl 
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TABLE J (continued) 


2 


A = 14 B = 14 


13 


12 


11 


10 


Probability 
0.05 0.025 0.01 0.005 
0o10- 0o10- 0o10- — 
0029 =ч — = 
10 049 9 020 8 008 7 003 
8.038 7.016 6 оов ‚002 
.023 6023 5.009 003 
027 011 3 004 .004 
.028 3011 2.003 2 ооз 
027 2 009 .009 1.002 
.023 2 023 1.006 0 оо 
016 1016 0 ооз 003 
038 0 оов 008 = 
020 0020 — — 
0.049 = — = 
041 8 016 7 006 6.002 
029 боп 5 004 004 
037 5015+ 4 005+ 3.002 
5041 017 3.006 2 001 
041 3016 2 005- 2 005- 
3 038 2013 1003 1 ооз 
2 031 1.009 1.009 9001 
1.021 loj 0 004 004 
1.048 0010+ = d 
0 025- 0025- = == 
033 7 012 6 004 6.004 
021 6021 5.007 002 
5 095* 4 009 009 3.003 
026 3 009 3 009 2 002 
.024 3.024 2.007 1.002 
.019 019 1.005- Loos- 
2 942 012 0.002 002 
028 0005 = 9 005 є em 
013 0013 == m 
030 — = — 
026 6 ооо 6.009 5.003 
039 5.014 .004 004 
5.043 016 .005- 3 005- 
4 042 .015- 2 004 .004 
.036 2011 1 ооз 1003 
027 1.007 1007 001 
1.017 1017 0 ооз 0 ооз 
1 озв 0007 0007 = 
017 0017 = = 
038 — — == 
.020 6.020 5.006 4 002 
5.028 009 009 002 
028 009 3 009 002 
024 024 2 007 looi 
018 2018 .004 .004 
.040 оп 002 0 002 
1 024 024 004 0 004 
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TABLE J (continued) 


Probability 
a 0.05 0.025 0.01 0.005 
7 0o10- 0o10- 0010- — 
A = 14 B = 10 6 022 002» — — 
5 054; E — — 
9 14 6.047 5914 4 004 4 004 
13 4018 4018 3.005- 3.005- 
12 3017 3017 2 004 2 004 
11 3042 2012 1 002 1.002 
10 2 029 1.007 1 oo; 0001 
9 1017 1017 0 002 0.002 
8 1.036 0 оов 0 006 — 
7 0014 0014 — = 
6 030 = — — 
8 14 036 4010- 40107 3.002 
13 039 оп 2 002 2 002 
12 032 оов 2 008 looi 
11 022 2 022 1.005- 1 005- 
10 .048 .012 0 002 0 002 
9 1.026 004 0 004 004 
8 009 0 ооо 0 ооо = 
7 020 0020 = — 
6 0040 — — — 
7 14 4 026 3 006 3 006 2 001 
13 025 006 2 006 1001 
12 017 2917 1003 003 
П 041 009 1.009 0 оо 
10 1.021 1.021 0 ооз 003 
9 .043 007 0007 — 
8 0015- 0o15- = == 
7 030 == — — 
6 14 018 3018 2 003 2 003 
13 014 014 loo 1.002 
12 087 loo; 1.007 001 
11 .018 1.018 0002 002 
10 1.038 0 005+ 0 005+ — 
9 012 0012 == — 
8 024 0.024 — — 
7 0 044 — — — 
5 14 2 010+ 2 010+ looi 1001 
13 037 1.006 006 001 
12 1.017 1.017 0002 .002 
11 1.038 0057 0005- 0005- 
10 оп on = = 
9 0022 022 == = 
8 0040 — — — 
4 14 2 039 1 0057 1 0057 1 005- 
13 019 1.019 0.002 .002 
12 ом 0057 0005- 0005- 
11 Ооп Ооп сас > 
10 023 023 — — 
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TABLE J (continued) 


A=15B=15 


A=15B=15 


14 


13 


12 


Probability 
0.025 


1 022 
.006 
0o15- 
0 оов 
0 025 


10 021 


018 
6 o10+ 


013 
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TABLE J (continued) 


Probability 
a 0.05 0.025 0.01 0.005 
6 05; 0017 — = 
5 0037 — — — 
11 15 7022 7 022 6007 5.002 
14 6032 501 4 003 4 003 
13 5934 4012 3.003 3.003 
12 4 032 3010+ 2 003 2.003 
11 3 026 2 008 2 008 1.002 
10 2 019 2019 1 004 1 004 
9 2 040 lon 0002 0002 
8 loj 1 004 0.004 0.004 
7 1.049 0o10- 0o10- — 
6 0.022 0.022 = = 
5 0046 — = = 
10 15 6017 6017 5 005- 5 005- 
14 5.023 5.023 4 007 3.002 
13 022 022 3 007 2 001 
12 018 018 2 005- 2 005- 
11 .042 013 1.003 1.003 
10 2 029 007 loo; 001 
9 1.016 .016 002 002 
8 .034 006 0 оов — 
A =з 15В - 10 7 0013 0013 — я- 
6 028 — — == 
9 15 694» 5012 4 003 4 003 
14 5.047 0157 3.004 004 
13 4 042 013 003 2 003 
12 3.032 .009 2 009 1.002 
11 2021 2021 1 005- 1 005- 
10 0457 loi 0.002 0002 
9 1 024 1 024 0.004 0.004 
8 048 0 ооо 0 ооо — 
7 019 0019 == == 
6 037 == == — 
8 15 032 4 008 4 оов 3 002 
14 033 3.009 3 009 002 
13 026 2 006 2 006 looi 
12 017 201 1.003 1.003 
11 037 1.008 1.008 001 
10 1.019 1.019 003 003 
9 038 0006 0 оов — 
8 .013 0013 = — 
7 026 == = = 
6 0507 = == == 
7 15 4 023 4 023 3.005- 3005- 
14 .021 021 2 004 004 
13 014 2014 1.002 1.002 
12 .032 1007 1007 001 
11 1.015+ 1.015+ 0.002 0.002 
10 .032 005- 0 005- 0 005- 
9 0оо+ 0010+ — — 
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TABLE J (continued) 


Probability 
a 0.05 0.025 0.01 0.005 
8 0020 0 о20 = = 
7 0038 - == = 
6 15 015* 3015+ 2 003 2 003 
14 оп 011 loo» 1002 
13 031 .006 1006 0001 
12 1.014 .014 0002 002 
11 1.029 .004 0 004 0 004 
10 009 0 ооо 0 ооо = 
9 917 017 — — 
8 032 = = — 
5 15 009 2 009 2 009 looi 
14 2032 1 005- 1 005- 1 005- 
13 014 1014 90, 001 
12 031 0 004 0 004 004 
11 008 0 оов 0 оов — 
10 0016 0016 к= — 
9 030 = — — 
4 15 035* 1.004 1.004 1.004 
14 016 lois 0001 0o01 
13 037 0.004 0.004 004 
12 009 0 ооо 009 — 
11 0018 0018 = — 
10 033 = = = 
3 15 020 1 ooo 0o01 Ооо! 
14 005- 0005- 0005- 0005- 
13 012 012 — — 
12 0025- 0257 — — 
11 0043 — — 
2 15 0007 0.007 0007 — 
14 0 022 0 022 == 
13 0044 — — — 
A = 16 В = 16 16 1 1022 1 1022 10 009 9 003 
15 994 019 8 оов 003 
14 8 027 012 6005- 6 005- 
13 033 015- 5 006 4 902 
12 037 016 4 006 002 
11 038 016 3.006 2 002 
10 037 015- 2 005- 2 005- 
9 033 012 1003 003 
8 027 1 оов 1.008 001 
7 019 1019 0 ооз 0 ооз 
6 041 0 ооо 0 ооо — 
5 0022 0 022 = = 
15 16 11.043 10018 9 007 8002 
15 033 014 7 005+ 002 
14 044 019 6 оов 5.003 
13 6023 023 5.009 4 003 
12 024 024 4 009 003 
11 023 023 3 оов 2 002 
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TABLE J (continued) 


Probability 
a 0.05 0.025 0.01 0.005 
9 3043 2016 1.004 1.004 
8 2 035- 1.010+ 0.002 0.002 
7 1.023 1.023 0.004 0 004 
6 Ооп 951 — — 
5 0 026 = = — 
14 16 10,5; 9014 8 005+ 7 002 
15 8 025+ 7010- 7 оо- 6 ооз 
14 7 032 6013 5 0057 5.005- 
13 6035+ 5014 4 005+ 3001 
12 5035+ 4014 3.005- 3.005- 
11 4 033 3012 2 004 2 004 
10 3 028 2.009 2 999 1.002 
9 2021 2021 1.006 0001 
8 2 045- 1.013 0.002 0.002 
7 1.030 0 006 0 оов — 
6 0515 0013 == = 
5 0031 = = == 
13 16 9 озо 8 оп 7004 7 004 
15 8 047 7 019 6 007 5 002 
14 6023 602 5.008 4 003 
13 5.023 5.023 008 003 
12 4 022 022 3.007 2 902 
11 048 018 2 005+ 1.001 
10 З озо 013 1.003 1.003 
9 2.029 1.008 1.008 0001 
8 .018 1.018 0 ооз 0 ооз 
7 .038 0 007 0007 — 
6 017 0017 — — 
5 037 — = g= 
12 16 8 024 8 024 7 оов 6.002 
15 7 036 013 5.004 004 
14 040 0157 4 057 4 005- 
13 039 014 3 004 004 
12 034 012 2 003 2 oos 
11 027 008 2 008 1.002 
10 .019 019 loos- .0057 
9 040 loi 0002 0.002 
8 1.024 1 024 0 004 004 
7 1.048 0010- 0107 — 
6 0021 021 — — 
5 0 044 — — — 
A - 16B = ll 16 7 019 7 019 6006 5002 
15 027 .009 5.009 4 002 
14 .027 4 009 4 009 002 
13 4 024 4024 3 оов 002 
12 019 019 2 005+ looi 
11 041 013 1 ооз 003 
10 2 028 .007 1.007 0001 
9 1016 1016 0 02 002 
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TABLE J (continued) 


10 16 


Probability 
0.05 0.025 
055 055 
0027 — 
046 вом 
5918 5.018 
.018 4018 
042 301 
3.032 2 009 
021 2 021 
042 loi 
023 1.023 
.045- 0 оов 
0017 0017 
0357 — 
037 5010- 
5.040 4 012 
4034 0107 
3025+ 007 
016 206 
2 033 1 оов 
017 low 
1.034 0.006 
012 0012 
024 0 024 
045+ — 
5 028 4 007 
028 3.007 
.021 3.021 
.047 2013 
2 028 1.006 
.014 1014 
1 027 0.004 
009 0009 
0017 0017 
033 => 
020 4 020 
3017 3017 
3045* on 
026 loos- 
1.012 loi 
024 024 
0457 007 
0014 0014 
026 — 
0.047 — 
3013 3013 
046 2 999 
2 025+ 1 004 
оп loi 
023 1.023 
0 
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TABLE J (continued) 


Probability 
a 0.05 0.025 0.01 0.005 
10 0012 0.012 — = 
А = 168 = 6 9 .023 023 — == 
8 0 040 — == тар 
15 2 028 1.004 1.004 004 
14 011 1.011 0 o; 0 оо 
13 025* .003 0 ооз 0 ооз 
12 047 0 оов 0 оов — 
11 0.012 0.012 — = 
10 023 023 == = 
9 039 — = — 
4 16 032 1 004 1.004 1004 
15 .013 1.013 0 оо lo; 
14 032 003 0 ооз 003 
13 007 0007 0 007 — 
12 014 0014 — — 
11 026 = — == 
3 16 loig lois 0 оо 0001 
15 004 004 0 004 0 004 
14 0010+ 0010+ == — 
13 021 021 — = 
12 036 = — 
2 16 007 0007 0007 — 
15 0.020 0.020 = 
14 039 = — — 
A- 17 B = 17 1 7 1202 12 022 1 1 009 10 004 


16 17 1204 Loig 10 00 9 ооз 
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TABLE J (continued) 


15 


A=17B=15 


14 


13 


12 


0.025 


0.01 


Probability 
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TABLE J (continued) 


Probability 
a 0.05 0.025 0.01 0.005 
8 1.032 0 oos 0 оов — 
7 012 0012 — — 
6 002 E = — 
11 17 016 7016 6 005- 6 005- 
16 022 022 5 007 4 002 
15 022 022 4 007 3.002 
14 019 4019 3 006 2001 
13 042 014 2 004 004 
12 3031 009 2 909 1.002 
11 2 020 2 020 1 005- 005- 
10 .040 oni 0o01 001 
9 1022 022 0 004 004 
8 .042 0 оов 0 оов — 
7 0016 0016 — = 
6 0033 — — = 
10 17 .041 651» 5.003 5.003 
16 604; 015* 4 004 004 
15 043 014 3 004 .004 
14 034 010+ 2 002 2 002 
13 024 024 2 007 001 
12 .049 015+ .003 .003 
А = 17В = 10 11 2031 loo; 1.007 9601 
10 016 1.016 0.002 0.002 
9 031 0 005+ 0 005+ — 
8 оп Ооп = = 
7 022 0.022 — — 
6 0 042 — — — 

9 17 6032 5.008 5.008 4 002 
16 034 0107 40107 З 002 
15 028 008 3 оов 2 002 
14 020 020 2 005- 2 005- 
13 042 012 1 002 1.002 
12 2 025+ 006 1 006 001 
11 048 1012 0 002 002 
10 024 024 004 004 

9 0457 008 0 оов — 
8 016 016 — — 
7 030 — — — 

8 17 024 5.024 4 006 3001 
16 .023 023 3 006 2001 
15 .017 017 2 004 004 
14 .039 20107 2 010- 1 002 
13 022 022 004 1.004 
12 .043 .0107 Loio- 001 
11 1020 1.020 003 003 
10 038 0.006 0 оов — 

9 1012 0012 — = 
8 022 0.022 — = 
7 0 оло — — — 
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TABLE J (continued) 


А=17В=4 13 


A=18B=18 18 


Probability 
0.025 
Зої 


.009 
2021 
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TABLE J (continued) 


Probability 
a 0.05 0.025 0.01 0.005 
12 6047 5 022 4 009 3 003 
11 046 020 008 002 
10 4043 018 006 looi 
9 3.038 014 1.004 004 
8 030 1.009 1.009 0 оо 
7 020 1.020 0 004 004 
6 044 0 o10- 0o10- — 
5 0023 0023 — — 

17 18 13 045+ 12019 11 008 10 003 
17 11 36 10016 9007 002 
16 10 049 9023 8010- 7 ооз 
15 8028 012 6.005- 6005- 
14 030 013 5 005+ 002 
13 031 013 4 (05- 4 005- 
12 030 012 3 004 004 
11 028 010* 2 003 003 
10 023 023 2 008 002 

9 047 018 1.005- loos- 
8 2 93; loi 0002 0 002 
7 0257 0257 0 005- 0057 
6 оп On — — 

5 .026 = = = 

16 18 12039 11016 10006 9 002 
17 10 029 012 8005- 8.005- 
16 038 8017 7 007 002 
15 043 019 6 оов 003 
14 046 .020 5 008 4 003 
13 6045+ .020 4 007 002 
12 042 018 3006 002 
11 4037 0157 2 004 2 004 
10 031 011 1003 1 ооз 

9 023 023 1.006 001 
8 046 1014 0002 0.002 
7 1.030 0 006 0 оов = 
6 014 014 = == 
5 031 = — = 

15 18 1133 10013 9 005- 9005- 
17 023 023 8 009 7 oos 
16 029 012 6 004 004 
15 031 .013 5.005- 0057 
14 031 .013 4 004 004 
13 .029 on 3004 3 004 

A=18B=15 12 4 025+ 3 009 3009 2 003 
11 020 3 020 006 001 
10 041 2014 1.004 004 
9 2 030 1.008 .008 001 
8 lois lois 0 ооз 0 ооз 
7 1.038 .007 0 007 -— 
6 0017 0017 — = 
5 0036 — = = 
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TABLE J (continued) 


14 18 


13 18 


12 18 


11 18 


Probability 
0.025 
90107 


.017 
7 021 
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TABLE J (continued) 


Probability 
a 0.05 0.025 0.01 0.005 
8 0010+ 0010+ = — 
7 .020 0020 ES — 
6 0039 = = T 
А = 18В = 10 18 7 087 6o10* 5.003 5.003 
17 6041 5013 4 003 4 003 
16 5 036 401 З ооз З ооз 
15 4 028 3 оов 3 оов 2.002 
14 3019 3019 2.0057 2 005- 
13 3 039 2011 1.002 1.002 
12 2 023 2 023 loos* 0 оо 
11 2043 loi 0o01 0001 
10 1.022 1.022 0 ооз 0 ооз 
9 1.040 0007 0007 — 
8 0014 0014 - == 
7 027 == — — 
6 0.049 = — = 

9 18 6029 5 007 5.007 4 002 
17 030 4 008 4 008 3.002 
16 023 4 ооз 3.006 2001 
15 016 016 004 004 
14 034 2.009 009 1.002 
13 019 2019 1.004 1.004 
12 037 1.009 1.009 001 
п 018 1.018 0.002 0.002 
10 1.033 0 005* 0 005+ = 

9 '010* 010* = = 
8 020 020 = = 
7 036 = == == 

8 18 022 5.022 4005- 4 905- 
17 020 4 020 3 004 004 
16 014 014 2 oos 003 
15 032 .008 2 008 looi 
14 .017 2017 1 ооз 1 oos 
13 034 1 007 1 oo; 0 оо 
12 .015+ lois* 0 002 002 
11 028 0 ооз 004 004 
10 1 049 0 008 0 оов — 

9 016 0016 = — 
8 028 = m — 
7 0 048 — — — 

7 18 4 015+ 4 015+ 3.003 3.003 
17 012 012 2 002 2 002 
16 032 2.007 2.007 001 
15 017 017 1.003 1003 
14 2 934 007 1.007 0001 
13 1.014 1014 002 002 
12 1027 .004 0.004 0 004 
11 1.046 0.007 0.007 — 
10 0515 013 — = 
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TABLE J (continued) 


A=18B=5 


А = 19В = 19 


Probability 
0.025 


3010- 
2.006 
2018 
loo; 
1 0157 
0 ооз 
0 007 


2 006 
2 021 


0.01 


30107 

2.006 

1.003 
007 
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TABLE J (continued) 


Probability 
a 0.05 0.025 0.01 0.005 
6 1.045- 0o10- 0o10- — 
5 0023 0093 — — 
18 19 046 020 12 oos 11003 
18 12 037 1017 10 007 003 
17 024 024 8.004 8 004 
16 030 014 7 006 6002 
15 033 015+ 6006 002 
14 035* бов 5 006 002 
13 0357 5015+ 4 оов 3 002 
12 033 4014 3.005- 0057 
11 4030 301 2 004 2 004 
10 025- 3.025- 2 оов 002 
9 049 2019 1.005+ 0001 
8 2038 1.012 0 002 0 002 
7 1 005+ 0 005- 0 005- 10057 
6 012 051 = ES 
5 027 — => = 
17 19 040 12016 11 006 10 002 
18 11.030 10013 9 005+ 8 902 
17 040 9018 008 003 
16 9047 8 022 7 009 003 
15 0507 7 023 6010- 5.004 
14 6023 6023 5010- 4 ооз 
13 .049 5.022 .008 .003 
А - 19 B = 17 12 5045- 4 019 3 007 2 002 
11 4039 3015+ 2.0057 2.0057 
10 032 2011 1 ооз 1 ооз 
9 024 2 024 1.007 0 оо 
8 294; Lois- 002 0 оо2 
7 1.031 0 006 0 оов Е 
6 014 0014 = = 
5 031 - — =: 
18 024 0024 9010- 8 004 
17 031 013 7 005+ 6002 
16 0357 015* 6 006 002 
15 036 015+ 5.006 4 002 
14 034 .014 4 005+ 002 
13 031 4013 004 004 
12 4027 0107 30107 2 003 
11 3021 .021 007 002 
10 042 0157 004 1.004 
9 2030 1.009 009 0 оо 
8 018 loig 0003 003 
7 037 0007 0 007 = 
6 017 0017 — == 
5 0036 = = = 
15 19 1.029 10011 9 004 9 004 
18 046 9019 8 007 7 002 


TABLE J (continued) 


14 


13 


А = 19 B = 13 


12 
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0.05 


7 025 3 


5945* 


002 


037 
8 042 


Probability 
0.025 


7025 = 
.024 


0.005 
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TABLE J (continued) 


Probability 
a 0.05 0.025 0.01 0.005 
9 1027 0 oos - 0005- 0005- 
8 .050- 0107 0o10- == 
7 019 0519 = — 
6 0037 — — — 

п 19 041 7 912 6003 6 ооз 
18 047 016 5 004 004 
17 .043 0157 4 004 4 004 
16 5 035+ 012 З ооз 003 
15 027 008 008 2 002 
14 .018 3018 005- 2 005- 
13 .035+ 010+ 1.002 1.002 
12 021 021 loos- 1.005- 
11 .040 loio* 9001 9001 
10 1.020 1.020 0 ооз 0 ооз 

9 037 0 006 006 = 
8 013 0013 = = 
7 0257 0025- = == 
6 0 046 — — — 

10 19 7 033 6 ооо 6009 5.002 
18 036 5011 4 ооз 4 003 
17 030 4 009 4 009 002 
16 022 4 022 3 006 001 
15 047 0157 2 004 004 
14 030 2.008 2 оов 1.002 
13 .017 2017 004 004 
12 2 933 1.008 1.008 9001 
11 016 1.016 0.002 002 
10 029 0057 0 005- 0057 

9 009 0 ооо 009 — 
8 .018 0518 — = 
7 032 = те € 
9 19 026 5 006 5.006 4001 
18 026 4 07 4 007 3001 
17 020 4 020 3 005- 0057 
16 044 013 2 003 2 003 
15 028 007 2 007 loo 
14 0157 2015- 1.003 003 
13 2 029 1.006 006 001 
12 013 lois 0.002 002 
11 024 024 0 004 0 004 
10 042 0007 0007 — 
9 0515 0013 = == 
8 024 024 -= = 
7 0 олз = = — 
A=19B=8 19 5919 5019 4 004 4 004 
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TABLE J (continued) 


Probability 
0.025 


1.021 
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TABLE J (continued) 


Probability 
a 0.05 0.025 0.01 0.005 
14 0 оз6 = 
2 19 0005- 0005- 0005- 0005- 
18 0014 014 - — 
A- 19B = 2 17 0 029 == => — 
16 бм lé € dis 
А = 20B = 20 20 "T nn 150% 13004 13 004 
19 lí; 13022 12010- Ius 
18 12032 Mo15* 10007 9 ооз 
17 119 10 020 009 004 
16 10 048 9 074 7 005- 7 005- 
15 8 027 7012 6 005+ 5.002 
14 028 013 5 995* 4.002 
13 028 012 40057 4 005- 
12 027 on 3.004 004 
11 024 024 3.009 2 003 
10 048 .020 2 007 loo 
9 3.041 2 015+ 1.004 004 
8 032 0107 Loio- 002 
7 022 1022 004 004 
6 046 000+ == = 
5 1024 0.024 = = 
19 20 15047 1400 13 oos 12003 
19 13 039 12018 11 оов 10 003 
18 1.026 012 9 005- 0057 
17 032 0157 8 006 002 
16 036 8017 7.007 6 003 
15 038 018 6 оов 003 
14 039 018 5.007 4003 
13 038 017 4 007 З 002 
12 035+ 015+ 3.005+ 002 
11 031 012 2 004 004 
10 026 009 2 009 1 002 
9 019 2019 loos* 001 
8 039 1.012 0 002 002 
7 1.026 .005+ 0005+ - 
6 012 012 == == 
5 .027 == ES — 
18 20 14041 13017 12 007 11 ооз 
19 12 032 014 10006 9 002 
18 П олз 10 020 9 оов 8 oos 
17 10 050- 024 004 004 
16 8 026 Tou 6005- 6005- 
15 027 6012 5.004 004 
14 026 rm 4 004 004 
13 024 .024 4009 З ооз 
12 047 4020 3.007 002 
11 041 016 005* 001 
10 3033 012 1.003 1.003 
9 024 024 1.007 9601 
8 2 048 lois- 0 ооз 003 
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TABLE J (continued) 


17 


A=20B=17 


16 


15 


14 


Probability 
0.025 


0014 


12014 
10011 
0157 
017 
7018 
6017 
016 
4013 
3010* 
3.022 
015+ 


0.01 


11 005+ 
9 004 
8 006 
7 007 
6.007 


0.005 


10 002 
.004 

7 002 
6 003 
5.003 
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TABLE J (continued) 


Probability 

a 0.05 0.025 0.01 0.005 
19 9 032 8012 7004 7 004 
18 8 035+ Том 6.005- 6005- 
17 7 0357 боз 5.005- 5.0057 
16 6031 5012 4 004 4 004 
15 026 4 009 4 009 З ооз 
14 020 4 020 3 007 002 
13 040 3015- 004 004 
12 3 029 2 009 2 009 1 002 
11 018 2018 1 005- loos- 
10 2 035+ 1 007 Loio- 001 

9 1.019 1.019 003 0 ооз 

8 1.037 0 007 0007 — 

7 014 0014 — — 

6 029 — — x 

13 20 9017 9017 8 005+ 7 002 
19 .025- .025- 7 оов 6 ооз 
18 026 009 6009 5.003 
17 602 .024 5 оов 4 002 
16 020 020 4 007 3 002 
15 041 .015+ 3.005- 3.005- 
14 031 оп 2 003 .003 

А = 20 B = 13 13 3 022 3022 2 006 looi 
12 041 013 1.003 1 ооз 
11 2 026 007 1 007 001 
10 .047 1 оз 002 0 002 
9 1.026 004 004 004 
8 047 0 ооо 009 — 
7 0.018 0018 — = 
6 0357 — — — 

12 20 9.044 8014 7 004 7.004 
19 7 o19 7 o19 6006 5.002 
18 018 018 5.006 4 902 
17 043 016 4 005- 4 005- 
16 5.034 012 3.003 003 
15 4 025+ 008 3 оов 2 002 
14 049 017 0057 2 005- 
13 3 033 0107 2 919- 1.002 
12 020 020 0057 1.005- 
11 .036 1009 009 001 
10 lois lois 0 ооз 0 ооз 

9 1.034 0 оов 0 оов = 
8 012 012 == — 
7 023 023 = = 
6 0545 — == — 

11 20 8037 7 o10* 6003 6003 
19 .042 .013 5.004 5.004 
18 6037 012 4 003 4 003 
17 .029 4 009 009 3 002 
16 402 4021 3.006 2 001 
15 042 014 2.003 2.003 
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TABLE J (continued) 


10 


A=20B=9 


Probability 
0.025 


2016 
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TABLE J (continued) 


Probability 
a 0.05 0.025 0.01 0.005 
17 30507 2011 1.002 1.002 
16 2 023 2 923 loo, loo, 
15 043 009 1.009 0o01 
14 016 1016 0.002 0.002 
13 029 0.004 0.004 004 
12 048 0.007 0007 — 
11 0015 0013 — = 
10 022 022 — = 
9 036 — — — 
6 20 046 3 оов 3 оов 2.001 
19 3.028 2 005- 2 005- 2 005- 
18 013 .013 1.002 1.002 
17 028 1.004 1 004 004 
16 010- loio- 1 010- 0 оо 
15 018 lois 0.002 0 002 
14 032 0.004 0 004 004 
13 007 0007 0 007 — 
12 0013 0013 — — 
11 022 0.022 = -— 
10 0357 = == = 
5 20 033 2.004 2.004 2 004 
19 016 2016 1.002 002 
18 038 005+ 1.005+ 0 ооо 
17 012 012 0 оо 0 оо 
16 023 023 0.002 0.002 
15 040 .005- 0 005- 0057 
14 0 ооо 0 ооо 0 ооо = 
13 0015- 0 015- — — 
12 024 024 — — 
11 .038 HE; ва — 
4 20 022 2 922 1 002 1.002 
19 008 1.008 1.008 000 
18 lois lois 001 0001 
17 1.035+ 0 ооз 003 0 ооз 
16 007 0 007 0 007 = 
15 0012 012 — — 
14 .020 020 = = 
13 05, — — — 
3 20 1012 1012 00; 00; 
19 .034 002 002 0 002 
17 Von 0o11 — = 
16 020 020 = — 
15 032 — = = 
14 047 - == 
2 20 0004 0004 0 004 0 004 
19 0515 0515 = 
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TABLE K Probability Levels for the Wilcoxon Signed Rank Test 


n=5 n=8 n 
T P T P T 
^0  .0313 0  .0039 0 

1 .0625 1 .0078 1 
2 .0938 2 0117 2 
3  .1563 3 0195 3 
4 2188 4  .0273 1 
5 43125 *5 .0391 5 
6  .4063 6  .0547 6 
7 5000 7  .0742 7 

8  .0977 8 

n= 9 1250 9 

0 0156 10 1563 ^10 

1 0313 11 1914 11 
“2 0469 12 2305 12 
3  .0781 13  .2734 13 
4 1094 14 3203 14 
5 1563 15 3711 15 
6 2188 16 4219 16 
7 2813 17 4727 17 
8 .3438 18 .5273 18 
9 .4219 n=9 19 
10 .5000 0 0020 20 
1 0039 21 

n=7 2  .0059 22 

0  .0078 3  .0098 23 
.0156 1 0137 24 
.0234 5 0195 25 

fi .0391 6  .0273 26 
.0547 7  .0371 27 
: 8 .0488 
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.0009 
.0012 
-0017 
.0023 
0031 


0040 


0052 
0067 
0085 
‚0107 


‚0133 
‚0164 
0199 
.0239 
.0287 


.0341 


.0402 
.0471 
.0549 


.0636 


.0732 
.0839 
.0955 
.1082 
.1219 


.1367 
4927 
.1698 
.1879 
22072 


.2274 
.2487 


“For given n, the smallest rank total for which the probability level is equal to or less than 0.0500. 
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TABLE K (continued) 


n2] n=9 п = 12 п = 13 
T P T P T P T P 
13  .4688 16  .2480 36 4250 36 .2709 
14  .5313 17 2852 37 4548 37 .2939 

18 3262 38 4849 38 3177 
19 3672 39 5151 39 3424 
20 4102 40 3677 
21 4551 41 3934 
22 5000 42 .4197 
43 .4463 
44 4730 
45 5000 

п = 14 п = 14 п = 15 п = 16 п = 17 n=17 
T P T P T P T P T E T P 
0 0001 50 4516 47 2444 39 0719 25 0064 74 4633 
2 0002 51 4758 48 2622 40 0795 26 0075 75 4816 
3 0003 52 5000 49 2807 41 0877 27 0087 76 5000 
+ 0004 50 2997 42 0964 28 0101 
5 .0006 n — 15 51 3193 43  .1057 29 0116 n = 18 
6 .0009 0001 52 3394 44  .1156 30 0133 6 0001 
7 .0012 0002 53 3599 45 1261 31 0153 10 0002 
8 .0015 0003 54 3808 46  .1372 32 0174 12 0003 
9 .0020 0004 55 4020 47  .1489 33 0198 14 0004 


Ф о № ~ © 
о 
c 
Ж 
©з 


© 
о 
с 
ч 
— — 


15 0083 12 0021 п = 16 53 2319 39 0398 20 0014 
16 0101 13 0027 3 0001 54 2477 40 0443 21 0017 
17 0123 14 0034 5 0.0002 55 2641 “41 0492 22 0020 
18 0148 15 0042 7 0003 56 2809 42 0544 23 0024 
19 0176 16 .0051 8 .0004 57 2983 43 0601 24 .0028 
20 0209 17 0062 9 .0005 58 3161 44  .0662 25 0033 
21 0247 18 .0075 10 .0007 59 3343 45 0727 26 0038 
22 0290 19 .0090 11 .0008 60 3529 46 0797 27 0045 
23 0338 20 0108 12 | .0011 61 37118 47 0871 28 0052 


h2 
> 
о 
o 
о 
N 
һә 
— 
© 
ке 
N 
со 
-— 
> 
E 
оо 
с 
De] 
> 
© 
— 
e 
> 
со 
© 
о 
сл 
© 
кю 
о 
Q 
© 


A-88 APPENDIX STATISTICAL TABLES 


TABLE K (continued) 


п = 14 п = 15 п = 16 п = 16 п = 17 п = 18 
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TABLE K (continued) 
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TABLE K (continued) 


n=21 п = 22 п = 22 п = 23 п = 23 п = 24 
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TABLE K (continued) 
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TABLE K (continued) 
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TABLE K (continued) 
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TABLE K (continued) 


TABLE K (continued) 
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A-95 


п = 29 
UE 
121  .0183 
122  .0193 
123  .0204 
124  .0216 
125 .0228 
126 .0240 
127 .0253 
128 .0267 
129  .0281 
130 .0296 
131 .0311 
132 .0328 
133 .0344 


n = 29 
T Р 
170  .1572 
171 1625 
172  .1679 
173 — 1292 
174  .1789 
175  .1846 
176 .1904 
177 .1963 
178  .2023 
179  .2085 
180 .2147 
181  .2210 
182  .2274 


n = 30 

T P 
n = 30 126  .0139 
55 .0001 127  .0147 
66  .0002 128  .0155 
71  .0003 129  .0164 
75  .0004 130  .0173 
78  .0005 131  .0182 
80 .0006 132  .0192 
82  .0007 133  .0202 
84  .0008 134  .0213 
85  .0009 135  .0225 
87 .0010 136  .0236 
88  .0011 137  .0249 
89  .0012 138  .0261 


n = 30 
T P 
175  .1225 
176  .1267 
177 311 
178 .1355 
179  .1400 
180  .1447 
181 1494 
182  .1543 
183 1592 
184  .1642 
185 .1694 
186 .1746 
187 1799 


n — 30 
T P 
224 .4356 
225 4436 
226 4516 
227 4596 
228  .4677 
229 4758 
230 .4838 
231 .4919 
232 .5000 


TABLE | Quantiles of the Mann-Whitney Test Statistic 


кә 


wo 


> 


a 


b 


m=2 3 
0 0 
0 0 
0 0 
0 0 
0 0 
0 1 
0 0 
0 0 
0 0 
0 0 
0 1 
1 2 
0 0 
0 0 
0 0 
0 0 
0 1 
1 2 
0 0 
0 0 
0 0 
0 1 
1 2 
2 3 


> 


-00000 


Own CO eN OOO NK OOOO 


a 


MOON въ OOS ONK COCO оноос о 
со OV UNO окно то оноо оо Фф 


ч 


юмо Ф мо NOAN =O съ COCO оноос о 


8 9 10 11 
000 0 
000 0 
000 0 
1111 
22 2 2 
83 8 4 4 
000 0 
0 1 1 | 
12 2 2 
33 4 4 
45 5 6 
66 7 8 
00 1 1 
2 2 $ 3 
$4 4 S 
$5 5 6. 7 
67 8 9 
8 10 11 12 
E 2 2 3 
34 5 6 
5 6 7 8 
7 8 9 10 
910 12 13 
11 13 14 16 


© зо о©соосо+ се OMUWNS чоюосо E 


——— 
со Ф м 


— 
oo 


кПотью O-uoomNO com—-oo 


— — 


14 15 16 17 18 


осоо мо UNO 


——— 
AnNonun 


0 


— 
ODN —00o0oc NANO 


— — — 
sore 


ото HNOYURWO тьюног 


- 
a 


18 


чм» окоо 


— — 
ono 00-300 — 


19 20 


0 сл о м – © 


A-96 APPENDIX STATISTICAL TABLES 


TABLE L (continued) 
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TABLE L (continued) 


n p m=2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 
.001 0 0 1 3 5 7 9 11 13 16 18 21 23 25 28 30 33 35 38 
.005 0 1 3 6 8 11 14 17 19 22 25 28 31 34 37 40 43 46 49 

И .01 0 2 5 8 10 ІЗ 16 19 23 26 29 32 35 38 42 45 48 51 54 
.025 1 4 7 10 14 17 20 24 27 31 34 38 41 45 48 52 56 59 63 
.05 2 6 9 13 17 20 24 28 32 35 39 43 47 51 55 58 62 66 70 
.10 4 8 12 16 20 24 28 32 37 41 45 49 53 58 62 66 70 74 79 
.001 0 0 1 3 5 8 10 18 15 18 21 24 26 29 32 35 38 41 43 
.005 0 2 4 7 10 13 16 19 22 25 28 32 35 38 42 45 48 52 55 

12 .01 0 9 6 9 12 15 18 22 25 29 32 36 39 43 47 50 54 57 61 
.025 2 5 8 12 15 19 23 27 30 34 38 42 46 50 54 58 62 66 70 
.05 3 6 10 14 18 22 27 31 35 39 43 48 52 56 61 65 69 73 78 
.10 5 9 13 18 22 27 31 36 40 45 50 54 59 64 68 73 78 82 87 
.001 0 0 2 4 6 9 12 15 18 21 24 27 30 33 36 39 43 46 49 
.005 0 2 4 8 11 14 18 21 25 28 32 35 39 43 46 50 54 58 61 

13 .01 1 3 6 10 13 17 21 24 28 32 36 40 44 48 52 56 60 64 68 
.025 2 5 9 13 17 21 25 29 34 38 42 46 51 55 60 64 68 73 77 
.05 3 7 11 16 20 25 29 34 38 43 48 52 57 62 66 71 76 81 85 
.10 5 10 14 19 24 29 34 39 44 49 54 59 64 69 75 80 85 90 95 
.001 0 0 2 4 7 10 13 16 20 23 26 30 33 37 40 44 47 51 55 
.005 0 2 5 8 12 16 19 23 27 31 35 39 43 47 51 55 59 64 68 

14 .01 1 3 7 11 14 18 23 27 31 35 39 44 48 52 57 61 66 70 74 
.025 2 6 10 14 18 23 27 32 37 41 46 51 56 60 65 70 75 79 84 
.05 4 8 12 17 22 27 32 37 42 47 52 57 62 67 72 78 83 88 93 
10 5 11 16 21 26 32 37 42 48 53 59 64 70 75 81 86 92 98 103 
.001 0 0 2 5 8 11 15 18 22 25 29 33 37 41 44 48 52 56 60 
.005 0 3 6 9 I3 17 21 25 30 34 38 43 47 52 56 61 65 70 74 

15 .01 1 4 8 12 16 20 25 29 34 38 43 48 52 57 62 67 71 76 81 
.025 2 6 11 15 20 25 30 35 40 45 50 55 60 65 71 76 81 86 91 
.05 4 8 13 19 24 29 34 40 45 51 56 62 67 73 78 84 89 95 101 
.10 6 11 17 23 28 34 40 46 52 58 64 69 75 81 87 93 99 105 111 
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TABLE L (continued) 


n p m=2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 
.001 0 0 3 6 9 12 16 20 24 28 32 36 40 44 49 53 
.005 0 3 6 10 14 19 23 28 32 37 42 46 51 56 61 66 

16 .01 1 4 8 13 17 22 27 32 37 42 47 52 57 62 67 72 
.025 2 7 12 16 22 27 32 38 43 48 54 60 65 71 76 82 
.05 4 9 15 20 26 31 37 43 49 55 61 66 72 78 84 90 
.10 6 12 18 24 30 37 43 49 55 62 68 75 81 87 94 100 
.001 0 1 3 6 10 14 18 22 26 30 35 39 44 48 53 58 
.005 0 3 7 11 16 20 25 30 35 40 45 50 55 61 66 71 

17 Ol 1 5 9 14 19 24 29 34 39 45 50 56 61 67 72 78 
.025 3 7 12 18 23 29 35 40 46 52 58 64 70 76 82 88 
.05 4 10 16 21 27 34 40 46 52 58 65 71 78 84 90 97 
10 7 13 19 26 32 39 46 53 59 66 73 80 86 93 100 107 
.001 0 1 4 7 11 15 19 24 28 33 38 43 47 52 57 62 
.005 0 3 7 12 17 22 27 32 38 43 48 54 59 65 71 76 

18 .01 1 5 10 15 20 25 31 37 42 48 54 60 66 71 77 83 
.025 3 8 13 19 25 31 37 43 49 56 62 68 75 81 87 94 
.05 5 10 17 23 29 36 42 49 56 62 69 76 83 89 96 103 
.10 7 14 21 28 35 42 49 56 63 70 78 85 92 99 107 114 
.001 0 1 4 8 12 16 21 26 30 35 41 46 51 56 61 67 
.005 1 ^ 8 13 18 23 29 34 40 46 52 58 64 70 75 82 

19 .01 2 5 10 16 21 27 33 39 45 51 57 64 70 76 83 89 
.025 3 8 14 20 26 33 39 46 53 59 66 73 79 86 93 100 
.05 5 11 18 24 31 38 45 52 59 66 73 81 88 95 102 110 
410 8 15 22 29 37 44 52 59 67 74 82 90 98 105 113 121 
001 0 1 4 8 13 17 22 27 33 38 43 49 55 60 66 71 
.005 1 ^ 9 14 19 25 31 37 43 49 55 61 68 74 80 87 

20 .01 2 6 11 17 23 29 35 41 48 54 61 68 74 81 88 9% 
.025 3 9 15 21 28 35 42 49 56 63 70 77 84 91 99 106 
.05 5 12 19 26 33 40 48 55 63 70 78 85 93 101108 116 
.10 8 16 23 31 39 47 55 63 71 79 87 95 103 111 120 128 
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TABLE M Quantiles of the Kolmogorov Test Statistic 


One-Sided Test 


р = .90 .95 975 .99 .995 

Two-Sided Test 
p-.80 .90 .95 .98 .99 
n= 1 900 950 975 .990 .995 
2 .684 .776 .842 -900 .929 
3 565 636 ‚708 .785 .829 
4 .493 .565 .624 .689 734 
5 447 .509 .563 .627 .669 
6 410 .468 519 577 617 
7 381 .436 .483 .538 576 
8 358 410 454 ‚307 .542 
9 .339 .387 .430 .480 .513 
10 .323 .369 .409 457 .489 
11 .308 .352 .391 437 .468 
12 .296 .338 .375 419 449 
13 .285 325 361 404 432 
14 .275 314 349 390 418 
15 .266 .304 .338 377 404 
16 .258 .295 927 .366 .392 
17 .250 .286 .318 .355 .381 
18 244 .279 .309 .346 371 
19 297 271 301 337 361 
20 .232 .265 294 .329 .352 
21 .226 .259 .287 ¿921 344 
22 .221 .253 .281 314 337 
23 216 24 275 .307 .330 
24 212 .242 .269 .301 .323 
25 .208 .238 .264 .295 317 
26 .204 .233 .259 .290 311 
27 .200 .229 .254 .284 .305 
28 .197 225 .250 .279 .300 
29 .193 .221 .246 .275 .295 
30 .190 .218 .242 .270 .290 
31 .187 .214 .238 .266 .285 
32 .184 211 .234 .262 .281 
33 .182 .208 .231 .258 .277 
34 .179 .205 .227 254 213 
35 177 ‚202 .224 .251 .269 
36 .174 .199 .221 247 .265 
37 .172 .196 .218 244 262 
38 .170 .194 .215 .241 .258 
39 .168 .191 .213 .238 .255 
40 .165 .189 210 .235 252 

Approximation for 
1.07 1.22 1.36 1.52 1.63 

п> 40 


h no и и y 
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TABLE N Critical Values of the Kruskal-Wallis Test Statistic 


n, 


һ м м 


> оо 


~ Ф 


Sample Sizes 


no пз 
1 li 

2 1 
2 2 
1 1 

1 

2 2 
3 1 
3 2 

3 3 

1 1 

2 1 

2 2 

3 1 


Critical 
Value 


Sample Sizes 


N = 


Critical 
Value 


6.4444 
6.3000 
5.4444 
5.4000 
4.5111 
4.4444 
6.7455 
6.7091 
5.7909 
5.7273 
4.7091 
4.7000 
6.6667 
6.1667 
4.9667 
4.8667 
4.1667 
4.0667 
7.0364 
6.8727 
5.4545 
5.2364 
4.5545 
4.4455 
7.1439 
7.1364 
5.5985 
5.5758 
4.5455 
4.4773 
7.6538 
7.5385 
5.6923 
5.6538 
4.6539 
4.5001 

3.8571 

5.2500 
5.0000 
4.4500 
4.2000 
4.0500 
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TABLE N (continued) 


Sample Sizes Critical Sample sizes 


Critical 
Value ni п, ns value 
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TABLE Oa Exact Distribution of ү? for Tables with from 2 to 9 Sets of Three 
Ranks (k = 3; n = 2, 3, 4, 5, 6, 7, 8, 9; P is the Probability of Obtaining a Value 
of у? as Great as or Greater Than the Corresponding Value of y?) 
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TABLE Ob Exact Distribution of X? for Tables with from 2 to 9 Sets of Three 
Ranks (К = 4; п = 2, 3, 4; P is the Probability of Obtaining a Value of ү? as 
Great as or Greater Than the Corresponding Value of y?) 
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TABLE P Critical Values of the Spearman Test Statistic. Approximate Upper-Tail 
Critical Values г, Where P(r > г.) = a, n= 4(1)30 Significance Level, a 


n .001 .005 010 025 .050 .100 
4 — — — — .8000 .8000 
5 — — .9000 .9000 .8000 .7000 
6 — .9429 .8857 .8286 7714 6000 
7 .9643 .8929 .8571 .7450 .6786 .5357 
8 .9286 .8571 .8095 .7143 .6190 .5000 
9 .9000 .8167 .7667 .6833 .5833 .4667 
10 .8667 .7818 .7333 .6364 .9515 4424 
11 ‚8364 ‚7545 ‚7000 .6091 .5273 .4182 
12 .8182 .7273 .6713 .5804 .4965 .3986 
13 .7912 .6978 6429 .5549 4780 ‚3791 
14 ‚7670 6747 6220 .5341 4593 3626 
15 ‚7464 .6536 .6000 5179 4429 .3500 
16 .7265 .6324 .5824 .5000 .4265 .3382 
17 .7083 .6152 .5637 .4853 .4118 .3260 
18 .6904 .5975 .3480 4716 .3994 .3148 
19 .6737 .5825 .5333 .4579 .3895 3070 
20 .6586 .5684 .5203 4451 3789 .2977 
21 .6455 5545 5078 4351 .3688 .2909 
22 .6318 .5426 .4963 4241 .3597 .2829 
23 .6186 .5306 .4852 .4150 .3518 22767 
24 .6070 .5200 .4748 .4061 .3435 2704 
25 .5962 .5100 4654 3977 3362 .2646 
26 .5856 .5002 .4564 .3894 .3299 .2588 
27 5757 4915 4481 3822 3236 .2540 
28 .5660 4828 4401 .3749 3175 .2490 
29 5567 4744 .4320 .3685 3113 2443 
30 9479 4665 4251 .3620 .3059 .2400 


Note: The corresponding lower-tail critical value for r, is —rf. 
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ANSWERS TO 
ODD-NUMBERED EXERCISES 


Chapter 1 
Review Exercises 


7. Situation A 
(a) 300 households (b) all households in the small southern town 
(c) number of school-aged children present (d) all that reported one or more 
children (e) nominal (categories: O children, 1 child, and so on) 
Situation B 
(a) 250 patients (b) all patients admitted to the hospital during the past 
year (c) distance patient lives from the hospital (d) 250 distances 


(e) ratio 
Chapter 2 
2.3.1. (a) 
Cumulative 
Class Cumulative Relative Relative 
Interval Frequency Frequency Frequency Frequency 
0-0.49 3 3 3.33 3.33 
.5-0.99 3 6 3.33 6.67 
1.0-1.49 15 21 16.67 23.33 
(Continued) 
Histogram of pindex Frequency polygon of pindex 
50 r- 50 
40H 40 
б 30- 5 30 
Ф Ф 
= = 
È 20|- 2 20 
10 |- 10 
o | | | | | | 0 | | | | І І 
0.25 0.75 1.25 1.75 2.25 2.75 0.25 0.75 1.25 1.75 2.25 2.75 3.25 
Pindex Pindex 
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Cumulative 
Class Cumulative Relative Relative 
Interval Frequency Frequency Frequency Frequency 
1.5-1.99 15 36 16.67 40.00 
2.0-2,49 45 81 50.00 90.00 
2.5-2.99 9 90 10.00 100.00 
(b) 40.096 (c) .7667 (d) 16.6796 (e) 9 (f) 16.6796 


(g) 2.17, because it composes almost 25 percent of the data and is the most 


frequently occurring value in the data set. 


(h) Skewed to the left. 


2.3.3. (a) 
Cumulative 
Class Cumulative Relative Relative 
Interval Frequency Frequency Frequency Frequency 
20-24.99 2 2 0.069 6.90 
25-29.99 11 13 0.3793 44.83 
30-34.99 6 19 0.2069 65.52 
35-39.99 2 21 0.069 72.41 
40-44.99 5 26 0.1724 89.66 
45-49.99 2 28 0.069 96.55 
50-54.99 1 29 0.0345 100.00 
Histogram of BMI Frequency polygon of BMI 
127 12— 
10 - 10 L— 
> 9r > 8r 
2 © 
5 6- 5 6b 
3 5 
2 2L 
0 0 | | | 
22.5 275 32.5 375 42.5 475 52.5 175 275 375 475 575 
ВМ! BMI 
(b) 44.83% (c) 24.14% (d) 34.48% (e) The data are right 
skewed (f) 21 
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2.3.5. (a) 
Class Relative 
Interval Frequency Frequency 
0-2 5 0.1111 
3-5 16 0.3556 
6-8 13 0.2889 
9-11 5 0.1111 
12-14 4 0.0889 
15-17 2 0.0444 
45 1.000 


> 12 4 


Frequenc 


Histogram of Hours 


Hours 


Frequency Polygon of Hours 


(b) Skewed right 
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2.3.7. (a) 
Cumulative 
Class Cumulative Relative Relative 
Interval Frequency Frequency Frequency Frequency 
110-139 8 8 0.0516 0.0516 
140-169 16 24 0.1032 0.1548 
170-199 46 70 0.2968 0.4516 
200-229 49 119 0.3161 0.7677 
230-259 26 145 0.1677 0.9354 
260-289 9 154 0.0581 0.9935 
290-319 1 155 0.0065 1.0000 
Histogram of Scores 
50 4 
40 - 
> 
2 30 
5 
8 
E 20 
10 4 


185 215 245 275 305 
Scores 


Frequency Polygon of Scores 


Frequency 


(b) Not greatly skewed 


T T T T T T T 
95 125 155 185 215 245 275 305 335 


Scores 


2.3.9. (a) 


Stem-and-Leaf Display: 
HospitalA 
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Stem-and-Leaf Display: 
HospitalB 


Stem-and-leaf of C1N=25 


Leaf Uni 


1 17 
2. 18 
4 19 
9 20 
(6) 21 
10 22 
6... 23 
3 24 


(b) Both asymmetric: А is skewed left, and В is skewed right. 


2.3.11. (a) 


t=1.0 


1 

4 

15 
11259 
233447 
2259 
389 
589 


Stem-and-leaf ofC2N=25 
Leaf Unit=1.0 


12 
1.3 
14 
15 
16 
17 
18 
19 
20 
21 


Cumulative 
Class Cumulative Relative Relative 
Interval Frequency Frequency Frequency Frequency 
.0-.0999 45 45 20.83 20.83 
.1-.1999 50 95 23.15 43.98 
.2-.2999 34 129 15.74 59.72 
.3-.3999 21 150 9.72 69.44 
.4—.4999 23 173 10.65 80.09 
.5-.5999 12 185 5.56 85.65 
.6-.6999 11 196 5.09 90.74 
.7—.7999 6 202 2.78 93.52 
.8—.8999 4 206 1.85 95.37 
.9-.9999 5 211 2.31 97.69 
1.0—1.0999 4 215 1.85 99.54 
1.1-1.1999 1 216 0.46 100.00 
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Histogram of S/R Ratio 


50 - 
40 4 
3 
5 30 4 
2 
9 
È 20 4 
10 4 
0- 
0.05 0.15 0.25 0.35 0.45 0.55 0.65 0.75 0.85 0.95 1.05 
S/R Ratio 
Frequency Polygon of S/R Ratio 
50 4 
40 4 
5 
5 304 
2 
© 
iE 204 
10 4 
0 T T T T T T T T T T T T T 
lO LO LO LO LO LO LO LO LO LO LO LO LO LO 
© © © су о) + б © гу о сб © = с 
© O ЧӘ Ө: E ОЛО ЛӨ АВ ге. 
S/R Ratio 
Stem-and-leaf of СІ N=216 
Leaf Unit = 0.010 
46 0 1245566777888899999999999999999999999999999999 
96 1 О0000000001122233334444555555666666677777778888999 
(34) 2 0011111223444444445566666788889999 
86 3 001111244445556668999 
65 4 00001122223333444568899 
42 5 002334444599 
30 6 02236788999 
19 7 012289 
13 8 0237 
9 9 05588 
4 10 236 


L 11 6 
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(b) Skewed right (c) 10, 4.62% (d) 196, 90.74%; 67, 31.02%, 143, 


19.91% 
2.5.1. (а) 1936 (b) 205.0 (c) nomode (d) 255 (е) 5568.09 
(f) 74.62 (р) 38.54 (h) 100.5 
2.5.3. (a) 47.42 (b) 46.35 || (c) 54.0,33.0 (d)296 (е) 76.54 
(f) 875 | (в) 1845 | (В) 13.72 
2.5.5. (а) 16Л5 | (b) 15 | (с) 15 (@ 43 (е) 12402 (f) 11.14 
(g) 66.51 | (Б) 825 
2.5.7. (а) 1.8172 | (b) 2 (0 2.17. (d) 2.83 (e) 3164 
(f) .5625 (в) 3095  (h).6700 
2.5.9. (a) 33.87 (b) 30.49 || (с) none || (d) 29.84 (е) 64.00 
(f) 8.00 (8) 23.62 ( 134 
2.5.11. (a) 6711 (Ы) 7.00 (с) 700 (d 16 (е) 1621 
(f) 4.026 (в) 59.99 (Б) 5.5 
2.5.13. (а) 204.19 (Б) 204 (с) 198, 204, 205,212 (@) 196 
(e) 1257.99 (f) 3547 (в) 1737 (h) 46 
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13. (a) Leaf Unit = 1.0 


Ди 2 "595 
4 2 67 
7 2 999 
10 3 001 
17 3 2223333 
(12) 3 444555555555 
21 з 666666666666666666677 


(b) skewed (c) surgery is performed before birth; birth is generally around 37 


weeks (d) x — 33.680, median — 35.00, s — 3.210, s? — 10.304 
15. (a) x — 43.39, median = 42, s — 17.09, C.V. = 39.387, s? — 292.07 
(b) Stem-and-leaf of GER N - 28 
Leaf Unit = 1.0 


1 1 8 

6 2 11377 
12 3 022267 
(7) 4 1223388 
9 5 158 

6 6 02378 

1 7 

dl 8 8 


(c) See graph on following page (A-113) 
(d) 67.9%, 96.55%, 100% 
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17. 


19. 


21. 


23. 


25. 


27. 


Boxplot of GFR 


90 — 
80 — 
70 4 
60 + 
504 
40 — 
30 4 


20-4 = cr —* 


10 + 


GFR 


Some examples include difference, diversity, departure, discrepancy, deviation, and 
entropy 

x — 3.95, Median = 3, s = 3.605, s? — 12.998 

Answers will vary: It is not uncommon for students to score higher on exams as a 
semester progresses; therefore, the exam scores are likely to be left skewed, making 
the median, which is less affected by skew, to be the better choice. 

Answers will vary: Using Sturges's rule, where w = £, k = 1 + 3.322(І0819300) 

= 9.23. An estimate of sample standard deviation can be found by dividing the 
sample range by 4. Therefore, s = R so that R ~ 4s. Using this formula, then R = 160 
and w = 160 = 17.33 suggesting that (d) ог (е) may be appropriate. 

Answers will vary: Imagine you are examining protein intake among college students. 
In general most students are likely to consume the average daily protein intake, but 
among this population, there is likely to be a fair number of athletes who consume 
large amounts of protein owing to the demands of their sport. In that case, the data are 
likely to be positively skewed, and the median better represents the central tendency 


of the data. 


Variable N Mean Median  TrMean StDev SE Mean 
S/R 216 0.3197 0.2440 0.2959 0.2486 0.0169 
Variable Minimum Maximum Q1 Q3 
S/R 0.0269 1.1600 0.1090 0.4367 


IQR — .3277, Range — 1.1331, IQR/R — .2892 


Boxplot of S/R Ratio 


25 
о 
sek ж 


S/R ratio 
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29. (a) Variable N Mean Median TrMean StDev SE Mean 


nutri 107 75.40 73.80 74,77 13.64 1.32 
Variable Minimum Maximum Ql Q3 
nutri 45.60 130.00 67.50 80.60 


Variance = 186.0496, Range = 84.4, IQR = 13.1, IQR/R = .1552 


Histogram of Status 


40 - 
30 /– 
> 
о 
c 
Ф 
а 20} 
Ф 
и 
10 |- 
0 | | | Т Т 1 
60 80 100 120 
Nutritional Status 
Frequency Polygon of Status 
40 4 
30 4 


Frequency 
No 
o 


= 
o 
1 


0 Т Т Т Т Т 
50 75 100 125 150 


Nutritional Status 


Stem-and-leaf of Cl N = 107 
Leaf Unit = 1.0 


1 4 5 
5 5 0004 
12 5 5556899 
18 6 013444 
31 6 5555666777888 
(28) 7 0000011122222222333333344444 
48 7 666666666677888999 
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30 8 000002234444 
18 8 56889 

13 9 01223 

8 9 679 

5 10 00 

3-0: 29 

2 11 

2 LL 

2 12 .3 

1 12 

113 0 

Boxplot of Status 
130 — * 
120 — Ы 
110 4 Е 
100 — 
8 90-j 
8 803 

70 — 

60 — 

50 4 

40 — % 


(d) 75.4 13.64; 61.76, 89.04; 79/107 = .7383; 75.4 + 2(13.64); 48.12, 102.68; 


103/107 = .9626; 75.4 + 3(13.64); 34.48, 116.32; 105/107 = .9813 


(е) 102/107 = .9533 (Е) 1/107 = .0093 


Chapter 3 


3.4.1. 
3.4.3. 
3.4.5. 


3.4.7. 
3.5.1. 


3.5.3. 


(а) .6631 (b) marginal (c) .0332 (d) joint (e) .0493 

(f) conditional (g) .3701 (h) addition rule 

(a) male and split drugs, .3418 (b) male or split drugs or both, .8747 

(c) male given split drugs, .6134 (d) male, .6592 

‚95 

301 

(a) A subject having the symptom (S) and not having the disease. 

(b) A subject not having S but having the disease. (c) .96 

(d) .9848 (e) .0595 (f) .99996 (g) .00628, .999996, .3895, .9996, 
.8753, .9955 (h) predictive value increases as the hypothetical disease rate 
increases 

19999977 


Review Exercises 


3. (a) .2143 (b) .5519 (c) .1536 (d) .4575 (e) .5065 
5. (a) .1349 (b) .6111 (c) .3333 (d) .5873 (e) .3571 
(f) .6667 (g) 0 (h) .3269 
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7. (a) 1. .2200 2. .5000 3. .0555 4. .1100 5. .5900 
(b) 1..3000 2. .3900 3. .3900 4. .1667 5. .0700 6. .6000 
9. (a) .0432 (b) .0256 (c) .0247 (d) .9639 (e) .5713 
(£) .9639 (2) 9810 
11. 0060 
13. .0625 
15. mothers under the age of 24 
17. null set, as events are mutually exclusive 
19. (a) plasma lipoprotein between 10—15 or greater than or equal to 30. 
(b) plasma lipoprotein between 10—15 and greater than or equal to 30. 
(c) plasma lipoprotein between 10-15 and less than or equal to 20. 
(d) plasma lipoprotein between 10-15 or less than or equal to 20. 
21. (a) .7456 (b) .3300 
23. .0125 
Chapter 4 
4.2.1. (a) 
Number of Frequency Relative Cumulative 
Substances Used Frequency Frequency 
0 144 .19 .19 
1 342 44 ‚63 
2 142. 18 81 
3 72 .09 .90 
4 39 .05 .95 
2 20 .03 .98 
6 6 .01 .99 
7 9 .01 1.00 
8 2 .003 1.003 
9 1 .001 1.004 
Total 777 1.004 
(b) | 054 
0.4 4 
> 
e 0.34 
E 
$ 0.2 7 
Е 0. 
0.1 - | 
0.0 й H a.. 


Se = 
7 8 9 


Number of Substances Used 
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1.0 1 
0.9 7 
0.8 7 
0.7 7 
0.6 7 
0.5 4 
0.4 4 
0.3 4 
0.2 4 


0.1 T T T T J; T T T T T 
0 1 2 3 4 5 6 7 8 9 


Number of Substances Used 


Frequency 


4.2.3. x = 1.58, 52 = 2.15, = 1.47 

4.3.1. (a) .1484 (b) .8915 (c) .1085 (d) .8080 

4.3.3. (a) .2536, (b) .3461 (c) .7330 (d) .9067 (e) .0008 
4.3.5. mean — 4.8, variance — 3.264 

4.3.7. (a) .5314 (b) .3740 (c) .0946 (d) .9931 (e) .0946 


(f) .0069 
4.3.9. 
Number of Probability, f(x) 
Successes, x 
0 3! 
m (.2)3(.8)° = .008 
1 3! 
ig ОВ) = 096 
2 3! 
amis )! C8) = .384 
3 3! 
ai )°(.8)? = .512 
Total 1 


4.4.1. (a) 156 — (b) 215 (е) 629  (d).320 
4.4.3. (a) 105  (b).032 (е) .007 (d) 440 
4.4.5. (а) 086 || (Б) 946 (е) 463  (d).664 (е) 026 
4.6.1. 4236 
4.6.3. 2912 
4.6.5. .0099 
4.6.7. 95 
4.6.9. 901 

4.6.11. —2.54 

4.6.13. 1.77 

4.6.15. 1.32 
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4.7.1. (a) .6321 (b) .4443 (c) .0401 (d) .3064 
4.7.3. (a) .1357 (b) .2389 (c) .6401 (d) .0721 (e) .1575 
4.7.5. (a) .3413 (b) .1056 (c) .0062 (d) .3830 
4.7.7. (a) .0630 (b) .0166 (c) .7719 
Review Exercises 
15. (a) .0212 (b) .0949 (c) .0135 (d) .7124 
17. (a) .034 (b) .467 (c) .923 (d) .010 (e) .105 
19. (a) .4967 (b) .5033 (c) .1678 (d) .0104 (e) .8218 
21. (a) .0668 (b) .6247 (c) .6826 
23. (a) .0013 (b) .0668 (c) .8931 
25. 57.1 
27. (a) 64.75 (b) 118.45 (c) 130.15 (d) 131.8 
29. 14.90 
31. 10.6 
33. (a) Bernoulli assuming there is an equal probability of both genders (b) Not 
Bernoulli—more than two possible outcomes (c) Not Bernoulli—weight is not a 
binary variable 
Chapter 5 
5.3.1. 204, 6.2225 
5.3.3. (a) .1841 (b) .7980 (c) .0668 
5.3.5. (a) .0020 (b) .1736 (c) .9777 (d) .4041 
5.3.7. (a) 9876 (b) .0668 (c) .0668 (d) .6902 
5.3.9. 
Sample X 
6, 8, 10 8.00 
6, 8, 12 8.67 
6,8, 14 9.33 
6, 10, 12 9.33 
6, 10, 14 10.00 
6, 12, 14 10.67 
8, 10, 12 10.00 
8, 10, 14 10.67 
8, 12, 14 11.33 
10, 12, 14 12.00 


5.4.1. .3897 
5.4.3. .0038 
5.4.5. .0139 
5.5.1. .1131 
5.5.3. .0808 
5.5.5. (a) .1539 
5.6.1. .1056 
5.6.3. .7938 


(b) .3409 


(c) .5230 
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Review Exercises 


11. .0003 
13. .0262 
15. .1335 
17. .1093 
19. .1292 


21. 252 
23. .53, 


.0476 


25. Atleast approximately normally distributed 
27. .9942 
29. (a) No (b) Yes (c) No (d) Yes (e) Yes (f) Yes 


Chapter 6 


6.2.1. 
6.2.3. 
6.2.5. 
6.3.1. 
6.3.3. 


6.3.5. 
6.4.1. 
6.4.3. 
6.4.5. 
6.4.7. 
6.4.9. 
6.5.1. 
6.5.3. 
6.6.1. 
6.6.3. 
6.7.1. 
6.7.3. 
6.8.1. 
6.8.3. 
6.9.1. 
6.9.3. 
6.9.5. 
6.9.7. 
6.10.1. 
6.10.3. 
6.10.5. 
6.10.7. 


(a) 88,92 (b) 87, 93 (c) 86, 94 
(a) 7.63, 8.87 (b) 7.51, 8.99 (c) 7.28, 9.22 
1603.688, 1891.563; 1576.125, 1919.125; 1521.875, 1973.375 
(a) 2.1448 (b) 2.8073 (c) 1.8946 (d) 2.0452 
(a) 1.549, .387 (b) 2.64, 4.36; .49, .91 (c) Nitric oxide diffusion rates 
are normally distributed in the population from which the sample was 
drawn. (d) narrower (e) wider 
66.2, 76.8; 65.1, 77.9; 62.7, 80.3 
—549.82, —340.17; - 571.28, —318.72; —615.52, —274.48 
—5.90, 17.70; — 8.15, 19.95; — 12.60, 24.40 
64.09, 479.91; 19.19, 524.81; —77.49, 621.49 
2.1, 4.5; 1.8, 4.8; 1.3, 5.3 
32.58, —25.42; —33.33, —24.67, —34.87, —23.13 
.1028, .1642 
.4415, .6615 
.0268, .1076 
—.0843, .2667 
27,16 
19 
683, 1068 
385, 289 
6.334, 44.63 
793.92, 1370.41 
1.17, 2.09 
170.98503 < o? < 630.65006 
44, 17.37 
.49, 2.95 
.9, 3.52 
5.13, 60.30 


Review Exercises 


13. x — 79.87, s? — 28.1238, s — 5.3; 76.93, 82.81 
15. p = .30; .19, .41 
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17. p, = 20; py = .54, 26, 42 

19. p = .90; .87, .93 

21. x= 19.23, s* = 20.2268; 16.01, 22.45 

23. —2.18, 2.82 

25. 362.73, 507.27 

27. 44, 74 

29. —.416, .188 

31. Level of confidence decreases. The interval would have no width. The level of 
confidence would be zero. 

33. 2, 8.1, 8.1 

35. All drivers ages 55 and older. Drivers 55 and older participating in the vision study. 

37. .2865, .3529 (Use z since n > 30) 


Chapter 7 


7.2.1. Reject Но because —2.57 < —2.33, р = .0051 < .01 
7.2.3. Fail to reject Ho because .76 « 1.333. p > .10 
7.2.5. Yes, reject Ho, z — —5.73 « —1.645. p < .0001 
7.2.7. No, fail to reject Но. = —1.5 > —1.709. 05 < p < .10 
7.2.9. Yes, reject Ho, z — 3.08. p — .0010 
7.2.11. z — 4, reject Ho, p « .0001 
7.2.13. t = .1271, fail to reject Ho. p > .2 
7.2.15. z = —4.18, reject Ho. p « .0001 
7.2.17. z — 1.67, fail to reject Ho. p — 2(.0475) — .095 
7.2.19. Reject Ho since z — —4.00. p « .0001 
7.3.1. Reject Но because —10.9 < —2.388, p « .005 
7.3.3. Reject Ho because —9.60 « —2.6591, p « 2(.005) 
7.3.5. Reject Ho because z — 3.39 » 1.96. p — 2(.0003) 
7.3.7. s = 5421.25, t = —6.66. Reject Ho. p < 2(.005) = .010 
7.3.9. z = 3.39. Reject Ho. p = 2(1 — .9997) = .0006 
7.3.11. t = —3.3567. Reject Ho. p < .01 
7.4.1. Reject Ho because 3.17 > 2.624, p < .005 
7.4.3. Reject Hy-3.1553 < —1.8125,.005 < p < .01 
7.4.5. Reject Ho since —4.4580 < —2.4469, p < .01 
7.5.1. Reject Ho since —1.62 > —1.645. p = .0526 
7.5.3. Reject Ho because —1.77 < —1.645, p = .0384 
7.5.5. Reject Ho because z = —2.21, p = .0136 
7.6.1. Reject Но because —2.86 < —2.58, p = .0042 
7.6.3. Fail to reject Ho because z = 1.70 < 1.96, p = .088 
7.7.1. Do not reject Ho since 5.142 < 20.723 < 34.267, p > .01 (two-sided test). 
7.7.3. x? = 6.15. Do not reject Ho. p > .05 (two-sided test) 
7.7.5. y? — 28.8. Do not reject Ho. p > .10 
7.7.7. x? = 22.036, .10 > p > .05 
7.8.1. Fail to reject because V.R. — 1.226 « 1.74p » .10 
7.8.3. No, V.R. = 1.83, p > .10 
7.8.5. Reject Но. М.В. = 4, .02 < p < .05 
7.8.7. V.R. = 2.1417, p > .10 
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7.9.1. 
Alternative Value of Power 
Value of u p Function 1 — В 
516 0.9500 0.0500 
521 0.8461 0.1539 
528 0.5596 0.4404 
533 0.3156 0.6844 
539 0.1093 0.8907 
544 0.0314 0.9686 
547 0.0129 0.9871 
7.9.3. 1.0 y 
0.8 У 
5 0.6 - 
з 
o 
а 0.4 4 
0.2 4 
0.0 - 


T T T T T T T T 
515 520 525 530 535 540 545 550 
Alternative values of mu 


Alternative Value of Power 
Value of u p Function 1 — В 
4.25 0.9900 0.0100 
4.50 0.8599 0.1401 
4.75 0.4325 0.5675 
5.00 0.0778 0.9222 
5.25 0.0038 0.9962 
1.0 
0.8 
5 0.6 
= 
o 
а. 0.4 
0.2 
0.0 
4.2 4.4 4.6 4.8 5.0 5.2 


Alternative values of mu 
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7.10.1. п = 548; C = 518.25. Select a sample of size 548 and compute x. If x > 518.25, 
reject Ho. If x « 518.25 do not reject Ho. 

7.10.3. п = 103; C = 4.66. Select a sample of size 103 and compute x If x > 4.66, reject 
Но. If x < 4.66, do not reject Ho. 


Review Exercises 


19. Reject Но since 29.49 > 2.33. p < .0001 

21. Fail to reject the null because z = 1.48 < 1.96. p = .1388 

23. Reject Ho since 12.79 > 2.58. p < .0001 

25. Fail to reject Ho because 1.10 « 1.645, p — .1357 

27. t = 3.873, р < .005 

29. d = 11.49, 52 = 256.679, sq = 16.02, t = 2.485, 025 > p > .01 
31. Reject Ho since —2.286 « 1.7530, .025 » p » .01 


Answers to Exercises 41-55 obtained by MINITAB 


41. 95.0% C.I. 
(456.8, 875.9) 
t p value 
7.09 0.0000 
Test of u = 0 vs. u not = 0 
43. 95.0% C.I. 
(0.224, 0.796) 
t p value 
3.65 0.0010 
Test of и = 0 vs. u not = 0 
45. Leg press: 95.0% C.I. Arm abductor: 95.0% C.I. 
(32.22, 56.45) (3.717, 7.217) 
t p value t p value 
7.85 0.0000 6.70 0.0000 
Test of и = 0 vs. м not = 0 Test of u = 0 vs. м not = 0 
Hip flexor: 95.0% С.І. Arm abductor: 95.0% С.І. 
(3.079, 6.388) (4.597, 7.670) 
t p value t p value 
6.14 0.0000 8.56 0.0000 
Test of и = 0 vs. м not = 0 Test of и = 0 vs. м not = 0 


Hip extensor: 95.0% С.І. 
(6.031, 10.236) 
t p value 
8.30 0.0000 
Test of и = 0 vs. u not = 0 


47. 95.0% C.I. 
(71.9, —26.5) 
t p value 
—4.34 0.0001 
Test of u = 0 vs. u not = 0 
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49. 95.0% C.I. for шу — шо : (—83.8, -20) 
t test и; — (vs. not =) : = —3.30p = .0021 d.f. = 42 
t test шу — (vs. <) : t = —3.30p = .0011 d.f. = 42 
51. 95.0% С.І. for и GROUP 1-и GROUP 2 (.5, 26.4) 
t test и GROUP 1 = и GROUP2 (vs. not =) : = 2.88 p = .045 d.f. = 4 
53. 95.0% C.I. for и — шо : (—3.00, 22) 
t test шу = m (vs. not =) : t = -.29р = .77 d.f. = 53 
Both use Pooled StDev — 4.84 
55. 95.0% СІ. for ирт — ис: (7.6, 18.8) 
t test Upp = Mc(vs.not =) : = 4.78 p = 0.0000 d.f. = 31 


Chapter 8 

Answers for 8.2.1-8.2.7 obtained by SAS” 

8.2.1. F = 6.24 
р = .0004 
Alpha 0.05 
Error Degrees of Freedom 325 
Error Mean Square 1.068347 
Critical Value of Studentized Range 3.65207 


Comparisons significant at the 0.05 level are indicated 


by жжж, 
Difference Simultaneous 
Group Between 95$ Confidence 
Comparison Means Limits 
90 - 30 0.1911 -0.1831 0.5652 
90 - 120 0.6346 0.1320 11:37 2 ER 
90 - 60 0.6386 0.1360 1.1413 *** 
30 - 90 01911 -0.5652 0.1831 
30 - 120 0.4436 -0.1214 1.0085 
30 - 60 0.4476 S9 1773. 1.0125 
120 - 90 -0.6346 21313727 0320 ARA 
120 - 30 -0.4436 -1.0085 0.1214 
120 - 60 0.0040 -0.6531 0.6611 
60 - 90 -0.6386 -1.1413  Á-0.1320 *** 
60 - 30 -0.4476 3140125 0.1173 
60 - 120 -0.0040 -0.6611 0.6531 
8.2.3. Е = 9.36 
р = <.0001 
Alpha 0.05 


Error Degrees of Freedom 109 


Error Mean Square 
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Critical Value of Studentized Rang 


Comparisons significant 
by ххх, 

Difference 
Group Between 
Comparison Means 
A-B 455.72 
Accu 574.54 
A-D 596.63 
B-A -455.72 
Bami 118.82 
B-D 140.91 
C-A -574.54 
EGB -118.82 
Qe 22.10 
D-A -596.63 
D-B -140.91 
DE =2 2% 10 
8.2.5. F = 9.26 

p = .0009 
Alpha 


Error Degrees of Freedom 
Error Mean Square 


at the 0.05 level 


211252.3 
3.68984 


are indicated 


Simultaneous 
95% Confidence 
Limits 
45.73 Sob. 71 XX 
235.48 91.359 ** 
287.88 905.99 % 
-865.71 Д5 DARA 
-271.45 509.09 
-223.34 55. 17 
-9134.59 -235.48 *** 
-509.0 2 1.45 
2259.95 304.14 
2905.39 =28 1882 EX 
e505. T7 223.34 
-304.14 259.95 
0.05 
26 
637.384 
3.51417 


Critical Value of Studentized Rang 


Comparisons significant 
by ххх, 
Difference 
Group Between 
Comparison Means 
Y-MA 18.16 
Y-E 48.13 
MA - Y -18.16 
MA-E 29.97 
E-Y -48.13 
E-MA -29.97 
8.2.7. F = 4.94 
р = .0026 
Alpha 


Error Degrees of Freedom 
ErrorMean Square 


at the 0.05 level 


are indicated 


Simultaneous 
95$ Confidence 
Limits 
-10.67 46.98 
20.07 76.19 *** 
-46.98 10.67 
T5 58.80 *** 
-76.19 =20 07 *** 
-58.80 ed gd 5 ET 
0.05 
174 
0.17783 
3.66853 


Critical Value of Studentized Rang 
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Comparisons significant at the 0.05 level are indicated 


by жжж, 

Difference Simultaneous 
Group Between 95$ Confidence 
Comparison Means Limits 
0-1 0.10165 -0.13866 0.34196 
0 =2 0.17817 -0.2188 0.37822 

Difference Simultaneous 
Group Between 95% Confidence 
Comparison Means Limits 
0-3 0.35447 Q;T0511 0260383 KER 
1^0 -0.10165 -0.34196 0.13866 
1-2 0.07652 -0.17257 0.32561 
1 =23 0.25281 -0.03737 0.54300 
2-0 -0.17817 -0.37822 0.02188 
2—1 -0.07652 -0.32561 0.17257 
2m 0.17630 -0.08154 0.43413 
3-0 -0.35447 70: 60383. 01051 1:*4% 
З= 1 -0.25281 -0.54300 0.03737 
3-2 -0.17630 -0.43413 0.08154 
8.3.1. V.R. — 19.79, p « .005 
8.3.3. V.R. = 3022, р < .005 


8.3.5. V.R. = 7.37, 025 > p > .01 

8.3.7. Total d.f. — 41 Block (Dogs) d.f. — 5 Treatments (Times) d.f. — 6, Error d.f. — 
30 

8.4.1. V.R. = 48.78, р < .005 

8.4.3. V.R. = 16.45, p < .005 

8.4.5. Total d.f. — 29, Block (Subject) d.f. — 9, Treatment (Time) d.f. — 2, Error 
d.f. = 18 

8.5.1. Ion V.R. = 6.18, р = .023; dose V.R. = 74.59, р = .000; inter V.R. = .89р = 
427 

8.5.3. Migraine У.К. = 19.98, p « .0001; treat V.R. = 2.13, р = .1522; interaction 
V.R. = 1.42, p = 2404 

Review Exercises 


13. V.R. — 7.04, p — .000. The sample mean for the healthy subjects is significantly 
different from the means of categories B, C, and D. No other differences between 
sample means are significant. 

15. V.R. — 1.35, p — .274. Do not reject Ho. 

17. Smoking status V.R. — 3.16, p — .052, Vital Exhaustion Group 
V.R. = 6.84, p = .003, Interaction V.R. = 2.91, p — .032 

19. V.R. — 423, p « .001 

21. V.R. — 6.320, p — .008 

23. V.R. — 3.1187, p — .043. The sample D mean is significantly different from the 
sample B mean. No other differences between sample means are significant. 
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A-127 


25. V.R. (Age) — 29.38, p < .001; Occupation V.R. — 31.47, p < .001; Interaction 
V.R. — 7.12, p « .001 
27. 499.5, 9, 166.5, 61.1667, 2.8889, 57.6346, « .005 


29. (a) Completely randomized, 


1.0438 « 3.35 


(b) 3, 


(c) 30, 


(d) No, because 


31. V.R. = 26.06, р < .001. HSD = 2.4533. All differences significant except шм — 


I Moderate 


33. V.R. = 2.37, p = .117, Tukey HSD not necessary. 


35. (a) One-way ANOVA 

(b) Response: post-pre training score 

(c) Factors: Groups of years of experience (with 4 levels) 

(d) surgical experience and interest in obstetrics 

(e) no carryover effects 

(f) treatment is years of experience d.f. — 3, total d.f. = 29, error d.f. — 26. 
37. (a) repeated measures 

(b) Response: BMD 

(c) Factors: time periods (with six levels) 

(d) diet, exercise, and calcium intake 

(e) no carryover effects 

(f) time factor d.f. — 5, subject factor d.f. — 25, total, error d.f. — 125. 
39. 
Analysis of Variance forbilirubi 
Source DF SS MS F P 
subject 17 2480.83 145.93 45.57 0.000 
time 6 89.09 14.85 4.64 0.000 
Error 102 326.65 3:20 
Total 125 2896.57 


41. СВ = Compression Ratio 
Analysis of Variance for С.К. 


Source DF SS MS F P 
Group 4 9092 2273 8.12 0.001 
Error 19 5319 280 
Total 23 14411 
Individual 95$ CIs For Mean 
Based on Pooled StDev 
Level N Mean StDev —---—4--------- R--------- R--------- +--- 
Control 6 79.96 5.46 (----- ж ) 
І 4 78.69 21.44 (------ Elton. cs ) 
II 4 47.84 23.74 (------ *x—————— ) 
III 5 43.51 10.43 (----- Xl cr ) 
IV 5. 33.32 20.40 (----- komo ) 
---+--------- 4--------- 4--------- +--- 
Pooled StDev = 16.73 25 50 75 100 


Tukey's pairwise comparisons 
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Family error rate- 0.0500 
Individual error rate = 0.00728 


Critical Value=4.25 


Intervals for (column level mean) - (row level mean) 
Control I II III 
I -3lI.19 
3972 
TI -0.34 -4.70 
64.58 66.41 
TEE 6.00 1.45 -29.41 
66.89 68.91 38.05 
IV 16.19 11.64 —p92. -21.61 
77.08 79.10 48.24 41.99 


43. Two-way ANOVA: BC versus heat, chromo 


Analysis of Variance for BC 


Source DF SS MS 
heat 1 0.1602 0.1602 
chromo 1 0.6717 0.6717 
Interaction 1 0.0000 0.0000 
Error 20 0.8119 0.0406 
Total 23 1.6438 
Analysis of Variance for AC 

Source DF SS MS 
heat 1 0.0468 0.0468 
chromo 1 0.4554 0.4554 
Interaction 1 0.0039 0.0039 
Error 20 0.4709 0.0235 
Total 23 0.9769 
Analysis of Variance for AC/BC 

Source DF SS MS 
heat 1 0.04524 0.04524 
chromo 1 0.00000 0.00000 
Interaction 1 0.00385 0.00385 
Error 20 0.05793 0.00290 
Total 23 0.10702 


45. C.A. =Congruence angle 
Analysis of Variance forC.A. 


Source DF SS MS 
Group 3 7598 2533 
Error 86 14690 171 


Total 89 22288 


o 


14. 


239 
.00 


.34 


.16 


.00 
.33 


© 


с 


ра 


.000 
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Individual 95$ CIs For Mean 


Based on Pooled StDev 


Level N Mean StDev 


----- 4---------4-------2-2-4---------4- 
Lateral 27 6.78 15.10 (----*----) 
Medial 26 -10.81 10.80 (----*----) 
Multi 17 -18.29 15.09 (------ too ) 
Normal 20 -7.00 10.76 (A LL ) 
----- 4---------4---------4---------4- 
Pooled StDev = 13.07 -20 -10 0 10 
Tukey's pairwise comparisons 
Family error rate-0.0500 
Individual error rate = 0.0103 
Critical value=3.71 
Intervals for (column level mean) - (row level mean) 
Lateral Medial Multi 
Medial 8.16 
2:1 «01. 
Multi 14.46 -3.21 
35.69 18.18 
Normal 3.66 -14.01 -22.60 
23.89 6.39 0.02 
47. 
Analysis of Variance for respons 
Source DF SS MS F P 
subject 5 25.78 516 4.72 .018 
temp 2 30.34 T5407 13.87 .001 
Error 10 10.93 1.09 
Total 17 67.06 
49. С.С. =glucose concentration 
Analysis of Variance for G.C. 
Source DF SS MS F P 
group 3 8.341 2.780 10.18 001 
subject 5 8.774 1:77:55 6.43 .002 
Error 15 4.096 0.273 
Total 23 21.210 
51. 
Analysis of Variance for T3 
Source DF Oo MS F P 
subject 11 8967 815 2455 .030 
day 2 12466 6233 19.50 .000 
Error 22 1033 320 
Total 35 28467 
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53. BBL=bloodbilirubin levels 


Analysis of Variance for BBL 


Source DF 55 MS E Р 
Group 2 4077 2039 3.31 0.090 
Error 8 4931 616 
Total 10 9008 
Individual 95$ CIs For Mean 
Based on Pooled StDev 
Level N Mean StDev ---+--------- 4--------- Ho == +--- 
Control 4 63.50 28.25 (-------- *--------- ) 
Hypercar 4 50.00 22.69 (--------- ko ) 
Hyperosm 3 98.00 22.27 (---------- ko ) 
---+--------- 4--------- 4--------- +=-- 
Pooled StDev= 24.83 30 60 90 120 
Tukey’ s pairwise comparisons 
Family error rate =0.0500 
Individual error rate = 0.0213 
Critical value =4.04 
Intervals for (column level mean) - (row level mean) 
Control Hypercar 
Hypercar -36.7 
63.7 
Hyperosm -88.7 210272 
ШӨ 6.2 
55. 
Analysis of Variance for breathing scores 
Source DF SS MS F P 
group 2 244.17 122.08 14.50 0.000 
Error 38 319.88 8.42 
Total 40 564.05 
Individual 95$ CIs For Mean 
Based on Pooled StDev 
Level N Mean StDev —-—-—-—4--------- +--------- T---------— +-- 
1 13 13.231. 11.739 (------ *----- ) 
2 14 13.786 2.833 (----- *k == ) 
3 14 18.643 3.713 (------ *k == ) 
----+--------- 4--------- 4--------- +-- 
Pooled StDev=2.901 12.5 15.0 17.5 20.0 


Tukey's pairwise comparisons 


Family error rate = 0.0500 
Individual error rate = 0.0195 


Critical value = 3.45 
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Intervals for (column level mean) - (row level mean) 
1 2 
2 3281 
221.77: 
3 -8.138 2982 
-2.686 -2.182 


57. PSWQ = PSWQ score 


Analysis of Variance for PSWO 


Source 
Group 
Error 
Total 


Level N 


1 15 
2 30 
3 19 
4 55 


Pooled StDev=8.655 


Tukey's pairwise comparisons 


Familyerror rate=0.0500 


Individual error rate=0.0103 


Critical value=3.69 


Intervals for (column level mean) - (row level mean) 
1 2 3 
2 17.459 
31.741 
3 29.025 -32.446 
6.575 -19.203 
4 -10.181 337329 -8.388 
2.975 -23.077 3.631 


DF SS MS F P 
3 16654.9 5551.6 74.11 0.000 
tIS 8614.6 74.9 
118 252695 
Individual 95$ CIs For Mean 
Based on Pooled StDev 
Mean StDev ----- H--------- 4F--------- ss ses +- 
624.9:33- 8,556 (---*---) 
38.333 7.494 (--*--) 
64.158 10.259 (---*---) 
66.536 8.678 (--*-) 
----- +-=-=-=-=-=====+=========+========-=+-= 
40 50 60 70 
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59. 


Analysis of Variance for Age 
Source 
Group 


Error 


Total 


Level 


Husband 
Wife 


5 


N 


Daughter 50 


65 
77 


DF 


Mean 
49.420 
71.985 
68.649 


Pooled StDev=7.641 


SS MS 
16323.2 8161.6 
11034.7 58.4 
2135149 


Individual 955 


Е Р 


139.79 0.000 


Based on Pooled StDev 


CIs For Mean 


O uc p m Arm 
7.508 (--*-) 
150126 (-*-) 
7.828 (-*-) 
асс +--------- Е Puntas 
48.0 56.0 64.0 72.0 


'ukey's pairwise comparisons 


Family error rate- 0.0500 
Individual error rate = 0.0192 


Critical уа1ае 3.34 


Intervals for (column level mean) - (row level mean) 
Daughter Husband 
Husband 254.959 
=19.170 
Wife -22.507 0.296 
215:5:952 6.375 


61. SAP — serum alkaline phosphatase level 


Analysis of Variance for SAP 
Source 
Grade 


Error 


Total 


DF 

2 
29 
31 


SS MS 
36181 18091 
94560 3261 

130742 


Е Р 
5.55 0.009 
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Individual 95% CIs For Mean 
Based on Pooled StDev 


Level N Mean StDev зребювьнтю о ЕЕ ен asss 

I 9 118.00 61.85 — CEDERE EDEN ) 

II 8 143.63 55.90 (========= зоба ) 

IE 15 194.80 54.82 ¡(A ЖАР ) 
—L--------- T--------- +--------- T----- 

Pooled StDev- 57.10 80 120 160 200 


Tukey's pairwise comparisons 


Family error rate = 0.0500 
Individual error rate =0.0197 


Critical value = 3.49 


Intervals for (column level mean) - (row level mean) 
I qe 
II -94.1 
42.8 
III -136.2 E249 
-17.4 10.5 
63. 
Analysis of Variance for Hematocrit 
Source DF SS MS F P 
Group 2 817.5 408.8 20.26 0.000 
Error 27 544.8 20.2 
Total 29 136253 


Individual 95$ CIs For Mean 
Based on Pooled StDev 


Level N Mean StDev --+--------- +--------- +--------- T---- 

Sham 10: 39.2007 2:573. (====%====) 

Treated 15 40.200 5.348 (===) 

Untreated 5 53.200 4.604 (====== Weile ) 
-—4--------- 4R--------- 4R--------- +---- 

Pooled StDev = 4.492 36.0 42.0 48.0 54.0 


Tukey's pairwise comparisons 


Family error rate=0.0500 
Individual error rate = 0.0196 
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Critical value = 3.51 


Intervals for (column level mean) - (row level mean) 


Sham Treated 


Treated -6.551 
24551 

Untreated -21.106 -18.757 
-8.894 -7.243 


65. Both — rhIGF-I -- rhGH 


Analysis of Variance for Respons 


Source DF SS MS F P 
Group © 4.148 1.383 1.239 0.282 
Error 16 15.898 0.994 

Total 19 20.046 


Individual 95$ CIs For Mean 
Based on Pooled StDev 


Level N Mean. StDéy. -——-—————-— аз ЕБЕЕЕЕЕЕЕ T------- 
Both 5 11.520 0.653 (EST BC UNA BUTS ) 
rhGH dy 1.250. «0.530 [узе наше MIC ET ) 
rhIGF-I 6 10.800 1.418 (A Ss закордон ) 
Saline 4 10.250 0.971 (==-=====5 APS четен ) 

--------- +---------+---------+----—-—— 
PooledStDev-0.997 10.0 11.0 12% 


Tukey's pairwise comparisons 


Family error rate = 0.0500 
Individual error гаїе = 0.0113 


Critical value = 4.05 


Intervals for (column level mean) - (row level mean) 
Both rhGH rhIGF-I 
rhGH -1.5354 
2.0754 
rhIGF-I -1.0086 -1.2786 
2.4486 2.1786 
Saline -0.6450 -0.9150 -1.2927 


3.1850 2.9150 2.3927 
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Chapter 9 

9.3.1. (a) Direct, (b) Direct, (c) Inverse 

9.3.3. y — 560 4- 0.140x 

9.3.5. у = 68.6 — 19.5x 

9.3.7. у = 0.193 + 0.00628x 

9.4.1 Predictor Coef SE Coef 
Constant 559.90 29.3 
Meth Dos 0.13989 0.06033 
S=68.28 R-Sq= 26.4% 


9.4.3. 


9.4.5. 


Analysis of Variance 


Source DF SS 
Regression i 25063 
Residual Error 15 69923 
Total 16 94986 


Confidence interval for Bi .011, .268 


Predictor Coef SE Coef 
Constant 68.64 16.68 
Cmax w/ 2191529 4.375 
s=18.87 R-Sq= 76.9% 


Analysis of Variance 


Source DF SS 
Regression 1 7098.4 7 
Residual Error 6 2137.4 
Total 7 923549 


T 
19,22 
2.32 


R-Sq(adj) = 21.5 


М5 Е 
25063 5.38 
4662 
T 
4.12 
-4.46 


MS 
098.4 
356.2 


Confidence interval for В, =3 002.37 8 282 


Predictor Coef SE Coef 
Constant 0.19290 0.04849 
DTPA GER 0.006279 0.001059 


S=0.09159 R-Sq = 58.5% 


Analysis of Variance 


Source DF SS 
Regression 1 0.29509 0. 
Residual Error 25 0.20972 0. 
Total 26 0.50481 


MS 
29509 
00839 


Confidence interval for B, 0.0041, 0.0085 


Е 
19,93 


Т 
3.98 
5.93 


R-Sq(adj) = 56.8 


Е 
35.18 


А-135 


0.035 


0.004 


Р 
0.000 
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9.5.1. (a) 580.6, 651.2 (Ы) 466.1, 765.6 
9.5.3. (а) —30.42, 5.22 (b) —62.11, 36.92 

9.5.5. (а) 0.3727, 0.4526 (b) 0.2199, 0.6055 

9.7.1. r = .466, t = 2.23, p = .038, .030 < p < .775 

9.7.3. r = —812, t = —3.11, p = 027, — 1 < p < —152 
9.7.5. r = —.531, t = —331, p = .003, - 770 < p < —.211 


Review Exercises 


17. BOARD = —191 + 4.68 AVG, r? = .772, t = 17.163, p < .001 


19. y-hat=12.6+1.80x 
Predictor Coef SE Coef T P 
Constant 12.641 2.133 5.93 0.000 
no.ofp 1.8045 09585 3.23 0.005 
5-7.081 R-Sq= 38.0% R-Sq(adj) = 34.45 


Analysis of Variance 


Source DF 55 MS Е Р 
Regression 1 523.41 523.41 10.44 0.005 
Residual Error 17 852.38 50.14 

Total 18 1375.79 


21. The regression equation із 
B=1.28+0.851A 


Predictor Coef SE Coef T P 
Constant 1.2763 0.3935 3424 0.006 
A 0.8513 0.1601 55/32 0.000 
s=0.2409 R-Sq= 68.5% R-Sq(adj) - 66.15 


Analysis of Variance 


Source DF 55 MS Е Р 
Regression 1 1.6418 1.6418 28.29 0.000 
Residual Error 13 0.7545 0.0580 

Total 14 2.3963 


23. у = 61.8819 + .509687x; V.R. = 4.285; .10 > p > .05; t = 2.07; 95% СІ for 
р: —.03,.79; 110.3022; 87.7773, 132.8271 


25. 


29. 


31. 


33. 


35. 
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у = 37.4564 + .0798x; V.R. = 77.13; p < .005; t = 8.78; 95% СА. for p: .91, 1; 


40.63, 42.27. 
The regression equation is 
A=570+0.429B 


Predictor Coef SE Coef 
Constant 569.8 141.2 
B 0.42927 0.04353 
5 = 941.6 R-Sq= 54.0% 


Pearson correlationof BandA=0.735 
P-Value = 0.000 


The regression equation is 
у= 45.0 +0.867х 


Predictor Coef SE Coef 
Constant 44.99 33.54 
x 0.86738 0.07644 
5= 102.9 R-Sq= 84.8% 


Pearson correlationof xandy=0.921 
P-Value = 0.000 


The regression equation is 
S=-1.26+2.10 DBS 


Predictor Coef SE Coef 
Constant =1 5263 3.019 
DBS 2.0970 0.1435 
s=8.316 В-ба = 90.3% 


Pearson correlation of Sand DBS =0.950 
P-Value=0.000 


The regression equation is 
log y=2.06+0.0559 PCu 


Predictor Coef SE Coef 
Constant 2.0603 0.3007 
PCu 0.05593 0.01631 


T P 
4.03 0.000 
9.86 0.000 


T P 
1.34 0. 193 
11.35 0.000 


T P 
-0.42 0.680 
14.62 0.000 
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S=0.3873 R-Sq-16.4$ R-Sq (adj) - 15.0% 


Pearson correlation of PCu апа log y=0.405 
P-Value=0.001 


37. The regression equation is 
C6=-0.141-1.33C5 


Predictor Coef SE Coef T P 
Constant -0.1413 0.2267 -0.62 0.540 
C5 -1.3286 0.1242 -10.69 0.000 
s=1.086 R-Sq = 84.5% R-Sq(adj) = 83.75 


Pearson correlation of IGELogE and SkinLogE = -0.919 
P-Value = 0.000 


39. Normotensive C6 = C4 — C5, C7 = (C4 + C5)/2, C8 = C2 — C3, C9 = 
(С2 + C3)/2 


The regression equation is 
C6=4.2+0.106C7 


Predictor Coef SE Coef T P 
Constant 4.19 17430 0.24 0.811 
C7 0.1060 0.1590 0.67 0.512 
s=5.251 R-Sq=2.0% R-Sq(adj) =0.0% 


Pearson correlation of Сб апа с7 = 0.141 
P-Value=0.512 


The regression equation is 
С8 =0.2+0.268 С9 


Predictor Coef SE Coef T P 
Constant 0.25 18.53 0.01 0.989 
C9 0.2682 0.2932 0.91 0.370 
s=5.736 R-Sq=3.7% R-Sq(adj) =0.0% 


Pearson correlation of C8 andC9=0.191 
P-Value =0.370 


Preeclamptic 


The regression equation is 
C6=57.9-0.363C7 


41. 


43. 
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Predictor Coef SE Coef 
Constant 57.89 Td 
C7 -0.3625 0.1273 
s=7.109 в-8а-26.95 


T 
34139 
-2.85 
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R-Sq (adj) = 23.65 


Pearson correlation of Сб апа С7 = -0.519 


P-Value=0.009 


The regression equation is 
C8=54.4-0.540C9 


Predictor Coef SE Coef 
Constant 54:377 9.771 
C9 -0.5403 0.1154 
s=5.787 В-ба = 49.9% 


P-Value = 0.000 


The regression equation is 
LBMD =0.131+0.511 ABMD 


Predictor Coef SE Coef 
Constant 0.13097 0.05413 
ABMD 0.51056 0.05935 
s=0.09188 R-Sq-53.6$ 


T 
5.56 
-4.68 


R-Sq(adj) = 47.65 


Pearson correlation of C8 апа C9 = -0.707 


T 
2.42 
8.60 


R-Sq (adj) = 52.9% 


Pearson correlation of ABMD and LBMD=0.732 


P-Value=0.000 


WL, VO; 


The regression equationis 
WL=0.01+0.262 VO2 


Predictor Coef SE Coef 
Constant 0.013 1.308 
VO2 0.26237 0.07233 
s=1.835 R-Sq= 52.3% 


Pearson correlation of WL апа VO220.723 


P-Value=0.003 
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45. 


WL, AT 


The regression equation is 
WL=0.75+0.367 AT 


Predictor Coef SE Coef 
Constant 0.752 1.761 
AT 0.3668 0.1660 
s=2.241 R-Sq= 28.9% 


Pearson correlation of WL ападт = 0.538 


P-Value =0.047 


WL, ET 


The regression equation is 
WL=0.74+0.00637 ЕТ 


Predictor Coef SE Coef 
Constant 0.739 1.173 
ЕТ 0.006375 0.001840 
s=1.879 R-Sq=50.0% 


Pearson correlation of Wh апа ЕТ = 0.707 


P-Value=0.005 


The regression equation is 
CL/F=19.4+0.893 CLer 


Predictor Coef SE Coef 
Constant 19.393 4.496 
CLer 0.89250 0.05671 
s=28.20 R-Sq= 59.3% 


T P 
0.43 0.677 
2.21 0.047 


R-Sq (adj) = 23.05 


E P 
0.63 0.541 
3.46 0.005 


T P 
4.31 0.000 
15.74 0.000 


R-Sq (adj) - 59.15 


Pearson correlation of CL/F andCLer-0.770 


P-Value=0.000 


Chapter 10 


10.3.1. $ = —31.4 + 0.473x, + 1.07x2 
10.3.3. $ = 13.45 + 4.02x, + 281% 
10.3.5. $ = —422.00 + 11.17x, — .63х› 
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10.4.1. 
Analysis of Variance 
Source DF Sum of Mean 
Squares Square F value BEIDE 
Model 2 1576.99011  788.49506 195.3:3 «.0001 
Error 32 136.29516 4.25922 
Corrected Total 34 17135299527 
Root MSE 2.06379 R-Square 0.9204 
Dependent Mean 51.25086 Adj R-Sq 0.9155 
Coeff Var 4.02684 
Parameter Estimates 
Parameter Standard 
Variable DF Estimate Error tValue Pr> |t] 95% Confidence Limits 
Intercept 1 -31.42480 6.14747 -5.11 «.0001 -43.94678  -18.90282 
X1 1 0.47317 0.06117 7.74 <.0001 0.34858 0.59776 
X2 1 1207117 0.06280 17.06 «.0001 0.94326 1.19909 
(a) .9204 (c) Хі p-value < .0001, X2 p-value < .0001 (d) 95% C.I. for 
slope for Ху: (0.34858 — 0.59776), 95% СІ. for slope for Ж: 
(0.94326 — 1.19909) 
10.4.3. 
Analysis of Variance 
Source DF Sum of Mean 
Squares Square F value Pr>F 
Model 2 452.56375 226.28188 ADO 0.0210 
Error 7 224.70025 32.10004 
Corrected Total 9 677.26400 
Root MSE 5.66569 R-Square 0.6682 
Dependent Mean 57.16000 Adj R-Sq 0.5734 
Coeff Var 9.91198 
Parameter Estimates 
Parameter Standard 
Variable DF Estimate Error tValue Pr> |t] 95% Confidence Limits 
Intercept 1 13.44923 13.23156 1.02 0.3433 -17.83843 44.73689 
xi 1 4.01680 1.07136 3:75 0.0072 1.48344 6.55016 
X2 1 2.81175 1.37859 2.04 0.0808 -0.44809 6.07160 
(a) .6682 (c) X, p-value = .0072, X» p-value = .0808 (d) 95% C.I. for 


slope for X; : (1.48344 — 6.55016) 
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10.4.5. 
Analysis of Variance 
Source DF Sum of Mean 
Squares Square F value Pr>F 
odel 2 17018 8508.89242 4.89 O OTTS 
Error 22 38282 1740.10069 
Corrected Total 24 55300 
Root MSE 41.71451 R-Square 0.3077 
Dependent Mean 537.00000 Adj R-Sq 0.2448 
Coeff Var 7.776807 
Parameter Estimates 
Parameter Standard 
Variable DF Estimate Error tValue Pr»|t| 95% Confidence Limits 
Intercept 1 -421.99671 339.76199 -1.24 0.2273 -1126.61995 282.62653 
X1 1 11.16613 3.65523 3.05 0.0058 3.58564 18.74663 
X2 1 -0.63032 0.93826 -0.67 0.5087 -2.57615 1.31552 


(a) .3077 (c) X p-value = .0058, X» p-value = .5807 (d) 95% С.І. for 
slope for X; : (3.58564 — 18.74663) 

10.5.1. C.I.: 50.289, 51.747. P.I.: 46.751, 55.284 

10.5.3. C.I.: 44.22, 56.59; P.I.: 35.64, 65.17 

10.5.5. C.I.: 514.31, 550.75; P.I.: 444.12, 620.94 

10.6.1. (a) Pairwise correlations: 


DNA-Bloo Co-cult DNA-Rect 


Co-cult 0.360 
DNA-Rect 0.532 0:303 
RNA-Rect 0.202 0.674 0.430 


(b) R — .370, F — 7.06, p — .001 
(c) Гу1.23 = .3472, 2.13 = .5232, Гуз.12 = —.2538 
(d) гуз = —.1660 
(е) 113.52 = .6615 
(f) 123.y1 = .3969 
10.6.3. (a) R= .9517, F = 57.638, p « .005 
(b), (c) 
ryj2 = 9268, t = 8.549, р < 01; ро = .3785, t = 1.417, 20 > p > .10; 
ri; = —.1789, t = —.630, p > 20 


Review Exercises 


7. R = 3496 F = .83 (p > .10) 
9. (a) $ = 11.419 + 1.2598x, + 3.1067x» (b) R? = .92 
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(c) 
Source SS af. MS V.R. р 
Regression 1827.004659 2 913.50 69.048 <.005 
Residual 158.728641 12 13.23 
1985.7333 14 


(d) $ = 11.419 + 1.2598(10) + 3.1067(5) = 39.55 
11. (а) $ = —126.505 + .176x, — 1.563х» + 1.575x3 + 1.6292x4 


(b) 
Source SS d.f. MS V.R. р 
Regression 30873.47 4 7718.367 13.37 <.005 
Residual 5714.93 10 571.493 
36648.40 14 


(c) гр = 4.40; t2 = —.78; в = 3.53; t4 = 2.59 
(d) R2.1234 = .842423; Ry 1234 = .91784 
13. (a) correlation 
(b) log plasma adiponectin levels 
(c) age and glomerular filtration rate 
(d) both correlations were not significant 
(e) subjects with end-stage renal disease 
15. (a) correlation 
(b) static inspiratory mouth pressure 
(c) forced expiratory volume, peak expiratory flow, and maximal inspiratroy flow 
(d) both correlations were not significant 
(e) boys and girls ages 7-14 


17. 

x1 x2 x3 x4 x5 x6 x7 x8 x9 x10 x11 x12 x13 
X1 1 
X2 7376 1 
хз —.109 244 1 
X4 -260(7) — .698(^) .316 1 
XS .556(7) .608(**) 273 .760(*) 1 
X6 .040 213 .136 .101 .647(*) 1 
X7 291 .289 .093 .293 A12( 231 1 
X8 .570(7)  .659(7) 227 .568(*) 16305 | —481C)  —.555(7) 1 
x9 .555(7)  .566(") .146 4540) MITE) —.503(*) —.650(°*) 492207) 1 
X10 345  .508(7) .419(*) A55(7) .640(*) —.377 —.480(*) .905(*) 7880) 1 
X11 4670) 4000) 224 621) .702(**) 3880) MA) .652(*) .646(“”) 58207) 1 
X12 .250 .260 .178 .228 448(*) 3900) 18(7) 641) MO) .667(7) .796¢*) 1 
X13 —.271 —.305 —.380 —.346  -.518(") .348 524°)  —.645(7) —.707(7) —.72907) .744(7) .864(7) 1 


** correlation is significant at the 0.01 level (2-tailed). 
* correlation is significant at the 0.05 level (2-tailed). 
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19. 
v1 v2 v3 v4 v5 v6 v7 v8 
vl 1 
v2 .123 1 
v3 .115 .963(**) 1 
v4 417С*) —.063 —.041 1 
у5 005 —.102 —.103 —.059 1 
v6 .001 27005) 295") —.036 .137 1 
v7 —.113 —.074 —.076 .052 .134 .061 1 
v8 .077 —.002 —.023 .146 .165 —.202 —.032 1 
** Correlation is significant at the 0.01 level (2-tailed). 
Chapter 11 


11.2.1. mobilizer: 0 G-CSF, 1-Etoposide 


The regression equation is 
сопс-12.9-0.0757 аде - 5.48 mobilizer 


Predictor Coef SE Coef T P 
Constant 127293,3 2.787 4.64 0.000 
аде -0.07566 0.04388 zd 72 0.092 
mobilize -5.480 1.429 9.24813 0.000 
5=3.965 В-5а= 27.1% R-Sq(adj) =23.6% 


Analysis of Variance 


Source DF SS MS F P 
Regression 2 240.02 120.01 7.63 0.002 
Residual Error 41 644.60 15472 

Total 43 884.62 

11.2.3. 


The regression equation is 
ОТс= 23.0 + 39.4 sex + 0.825 dose 


Predictor Coef SE Coef T P 
Constant 22.98 46.92 0.49 0.632 
sex 39.40 42.14 0.93 0.366 
dose 0.82456 0.07556 10.91 0.000 


s=84.10 R-Sq = 89.6% R-Sq(adj) =88.1% 


Analysis of Variance 


Source DF 
Regression 2 
Residual Error 14 
Total 16 
11.3.1. 

Step 1 
Constant 51.93 
MEM 0.66 
T-Value 4 1:5 
P-Value 0.000 
SOCIALSU 

T-Value 

P-Value 

CGDUR 

T-Value 

P-Value 

S 17.4 
R-Sq 25.20 
R-Sq (adj) 24.44 
11.3.3. 


Alpha-to-Enter: 0.1 


ResponseisR 


Step 


Constant 


AGEABUSE 
T-Value 
P-Value 


VERBALIO 
T-Value 
P-Value 


STIM 
T-Value 
P-Value 


ANSWERS TO ODD-NUMBERED EXERCISES 


SS MS F 
850164 425082 60.10 
99018 7073 
949182 
2 3 
116.07 115.54 
0.60 0.57 
2487 oS 
0.000 0.000 
-0.476 -0.492 
-5.28 ОЭ 
0.000 0.000 
0.122 
1.88 
0.064 
15.4 15.2 
41.92 43.97 
40.72 42.22 


15 Alpha-to-Remove: 0.15 
EACTIVE on 6 predictors, with М = 68 


P 
0.000 
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S 1.06 1-01 0.990 
В-5а 8.57 18.10 29:15 
R-Sq (adj) 7.19 154558 19:755 
C-p 10.4 4.6 2D 
11.4.1. 
Standard Wald 
Parameter DF Estimate Error Chi-Square Рг.» СБіЗа 
Intercept 1 2.1192 0.1740 148.3439 «.0001 
sex 1 0.0764 0.2159 0.1252 0.7234 
Odds Ratio Estimates 

Effect Point Estimate 95$ Wald Confidence Limits 
sex 1.079 0.707 1.648 
Review Exercises 
15. $ = 1.87 + 6.3772х + 1.9251x» 

Coefficient Standard Error t 

1.867 .3182 5.87 

6.3772 .3972 16.06 

1.9251 .3387 5.68 

R? = .942 

Source SS df. MS V.R. 

Regression 284.6529 2 142.3265 202.36954 

Residual 17.5813 25 .7033 

302.2342 27 


17. $ = —1.1361 + .07648x, + .7433x2 — .8239x3 — .02772x1x2 + .03204x1x3 
Coefficient Standard Deviation t р“ 
— 1.1361 .4904 —2.32 .05 > p > .02 
.07648 ‚01523 5.02 < .01 
‚7433 ‚6388 1.16 » 20 
—.8239 .6298 —1.31 20 > p > .10 
—.02772 .02039 —1.36 20>p>.10 
.03204 .01974 1.62 .20 > p > .10 


^ Approximate. Obtained by using 35 d.f. 


К? = 834. 
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Source SS af. MS V.R. 
Regression 3.03754 5 .60751 34.04325 
Residual .60646 34 
3.64400 39 .01784 
_ ГТА | J 1ifB 
?? — 1 Oif otherwise 3 = 1 Oif otherwise 
For А: $ = (—1.1361 + .7433) + (.07648 — .02772)x, = —.3928 + .04875x, 
For В: $ = (—1.1361 + .8239) + (.07648 + .03204)x, = —1.96 + .10852x, 
For C: у = 1.1361 + .07648x, 


23; 
Response - V, Dummyl = 1 if infant, O otherwise, Dummy2 = 1 if Child, 0 
otherwise 


The regression equation is 
у= 11.7+ 0.137 - 11.4 DUMMY1 -11.7 DUMMY2 + 0.226 INTER1+0.223 


INTER2 
Predictor Coef SE Coef T P 
Constant 11.750 3.822 3.07 0.004 
W 0.13738 0.05107 2.69 0.010 
DUMMY1 —11.421 4.336  —2.63 0.012 
DUMMY2 —11.731 3.966 —2.96 0.005 
ТМТЕВ1 0.2264 0.2208 1.03 0.311 
ТМТЕВ2 0.22332 0.06714 33.3 0.002 
s=1.73234 В=за = 94.9% R=sq(adj) = 94.3% 
Analysis of Variance 
Source DF SS MS F B 
Regression 5 2304.47 460.89 153.58 0.000 
Residual Error 41 123.04 3.00 
Total 46 2427.51 
Source DF Seg SS 
W 1 2265.07 
DUMMY1 1 5.59 
DUMMY2 1 0.00 
ТМТЕВ1 1 0.60 
INTER2 1 33.20 
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Unusual Observations 


Obs 
17 
36 
41 
46 


Rdenotes an observat 


X denotes an observat 


10. 
47. 
96. 
87. 


ооо со = 


V 
8.366 
15.400 
20.000 
30.900 


Fit 
4.257 
16.971 
24.938 
23.702 


5] 
0 
1 
1 
0 


E Fit Residual St Resid 
.496 4.109 2.48R 
.145 —1.571 —1.21X 
.265 —4.938 —4.17RX 
.881 7.198 4.83R 


tion with a large standardized residual. 


tion whose X value gives it large influence. 


8),p > 2(.035) = .070. Do not reject 


Chapter 12 

12.3.1. X? =2.072, p > .05 

12.3.3. X? = 3417, p > .10 

12.3.5. X? = 221, p > .10 

124.1. X? = .078, p > .10 

12.4.3. X? — 816.410, p « .005 

12.4.5. X? — 42.579, p « .005 

12.5.1. X? = 3.622, df. = 3, p > 10 

12.5.3. X? = 297, df. = 1, p > .10 

12.5.5. X? = 82.373, df. = 2, p < .005 

12.6.1. Since b = 7 > 3 (forA = 10,B = 10,a 
Ho. 

12.6.3. Since b = 1 (forA = 9,B = 7,а = 16),p 

12.7.1. RR = 13.51, 95% C.I. 9.7, 18.8 

12.7.3. X? = 12.898, p « .005, OR = 1.967 

12.7.5. OR yyy = 3.733, Хин = 25.095, p < .005 

Review Exercises 


15. X? = 7.124, d.f. = 3, p > .05, Fail to reject. 
17. X? = 240516, p > 10 
19. X? = 5.1675, p > .10 
21. X? = 67.8015, p < .005 
23. X? =7.2577.05 > p > .025 


25. Independence 


27. Homogeneity 
35. Overall Satisfaction 


Xx? 


= 3.143 


d.f. = 2, p = 0.208 
2 cells with expected counts less than 5.0 


2(.002) = .004. Reject Ho. 
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Pain 

X? — 0444 

d.f. = 2, p = 0.801 

2 cells with expected counts less than 5.0 
Nausea and Vomiting 

X? — 0483 

d.f. = 2, p = 0.785 


37. OR = 2.06; 95% C.I.: .92, 4.61 
41. X? — 13.530 
d.f. = 1,p = 0.000 
43. Test statistic — 2, p = .019 (one-sided test) 
45. X? — 8.749 


d.f. = 1,p = 0.003 
47. Х? — 4.875 
d.f. = 1,p = 0.027 


49. OR = 3.79; 95% C.I.: 1.52, 9.480R 
51. Х? = 11.589 
d.f. = 1,p = 0.001 


Chapter 13 


13.3.1. P — .3036, p — .6072 

13.3.3. P (x € 2|13,.5) = .0112. Since .0112 < .05, reject Ho. p = .0112 
13.4.1. 7, = 48.5. .1613 < p < .174 

13.4.3. T — 11.5, .1054 « p « .1308 

13.5.1. X? — 16.13, p « .005. 

13.6.1. T — 712.5, p — .2380, Fail to reject Ho. 
13.6.3. S — 1772.5, p — .7566, Fail to reject Ho. 
13.7.1. D = .3241, p < .01 

13.7.3. D = .1319, p > 20 

13.8.1. H — 11.38, p — .003, df — 3. 

13.8.3. Н = 18.13, p < .0001, df. = 2. 

13.8.5. H — 19.61 (adjusted for ties), p « .005 
13.9.1. x? = 8.67, p = .01 

13.9.3. у; = 29.38, p < 005 

13.10.1. г, = —0.07, p > .20 

13.10.3. r, — .018, n = 20, p > .05 

13.10.5. r, = —43,n = 30, .01 < p < .02 
13.11.1. $, = 1.429 


(Ёо), м = —176.685 
(Bo), м = —176.63 
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A-150 ANSWERS TO ODD-NUMBERED EXERCISES 


Review Exercises 


7. T=0,n = 7, p = .0078 
9. x2 = 16.2, p < 005 


11. D = .1587, p > 20 
13. r, = .09, p = 4532 
15. T — 29.5, p — 0.0263, Reject Ho 


17. H — 9.02, d.f. 2 3, p = 0.029 


Н = 9.30, d.f. = 3, p = 0.026 (adjusted for ties) 


19. 
21. 
23. 


rs = —.036, p = .802 

T — 62.5, p = .0072, Reject Ho 

USO: x? = 3.94, р = .140 

BSO: x? = 4.77, p = .093 

T — 89, p — .0046, Reject Ho 

PFK: T — 38, p — .8598, Fail to reject Ho 
HK: T = 61.5, p = .0703, Fail to reject Но 
LDH: T — 37, p — .7911, Fail to reject Ho 
rs = .733, p = .001 


25. 
27. 
29. 


Chapter 14 
14.3.1 


Number of Cases: 53 Censored :34 (64.1 5%) 


Standard Error 
1-10 


Survival Time 
Mean: 12.57 
(Limited to 19.00) 
Median: 16.00 1.80 
Percentiles 
25.00 50.00 75.00 
18.00 16.00 4.00 
1.80 3.76 


Value 
Standard Error 


14.4.3 Support group: 
Number of Cases: 22 Censored 
Survival Time Standard Error 
45.09 3.98 
60.00 .00 


Mean: 
Median: 


Percentiles 
25.00 50.00 75.00 
60.00 60.00 26.00 

6.96 


Value 
Standard Error 


Events: 19 


95% Confidence Interval 
(10.40, 14.73) 


(12.47, 19.53) 


:0(.002) Events: 22 
95% Confidence Interval 

(37.29, 52.89) 

( б, ША S) 
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Nonsupport group: 


Number of Cases: 28 Censored: 0 (.00%) Events: 28 
Survival Time Standard Error 95% Confidence Interval 
Mean: 16.04 1.86 (12.39,19.68) 
Median: 15.00 5.29 ( 4.63, 25.37) 
Percentiles 
25.00 50.00 75.00 
Value 22.00 15.00 7.00 
Standard Error 3.44 5.29 292 


Log Rank Statistic and (Significance): 29.22 ( .0000) 
Breslow Statistic and (Significance): 23.42 ( .0000) 
Tarone-Ware Statistic and (Significance): 26.28 ( .0000) 


Breslow's Test = 21.843, р< 0.001 


14.5.1 The variable “weight” was significant in this model when used to predict time-to- 
onset of cancer after exposure to UV light. 100(е"9 — 1) = 20.9%; therefore, for 
each unit increase in weight, the hazard for time-to-onset of cancer increases by 
20.9%. 

14.5.3 (a) Age: B = In(1.69) = .525; Tumor size: 8 = In(1.32) = .278; Chemotherapy: 

В = In(.88) = —.128; Radiation: В = In(.54) = —.616. 
(b) The hazard of metastases is increased to 1.69 times for those 50+, 1.32 times if 
the tumor size is > 2cm, .88 times for those receiving chemotherapy, and is .54 
times for those receiving radiation. Hence, increased age and larger tumor size are 
predictive of increased metastases, whereas chemotherapy and radiation are 
protective against metastases. 


Review Exercises 
7. h(t) = .25/.15 = 1.67 
As(t) 
9, 03 = — ———— = —.24 
(10 — 2) 


11. Survival Analysis for DAYS 


Factor GRADE = 1 


Time Status Cumulative Standard Cumulative Number 

Survival Error Events Remaining 
450 1 . 8889 .1048 dl. 8 
556 1 .7778 .1386 2 7 
2102 1 .6667 1544 3 6 
2756 0 3 5 
3496 0 3 4 
3990 1 .5000 .1863 4 3 
5686 0 4 2 
6290 0 4 1 
8490 0 4 0 
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Number of Cases: 9 Censored:5 (55.56%) Events:4 
Survival Time Standard Error 95% Confidence Interval 
Mean: 5255 1197 (2910, 7601) 
(Limited to 8490) 
Median: 3990 E ( sy А ) 


Survival Analysis for DAYS 


Factor GRADE = 2 


Time Status Cumulative Standard Cumulative Number 
Survival Error Events Remaining 
106 1 203323 ¿1521 1. 5 
169 1 .6667 .1925 2 4 
306 1 .5000 .2041 З E 
348 1 .3333 «1925 4 2 
549 1 .1667 „1521 5 1 
973 T .0000 .0000 6 0 
Number of Cases: 6 Censored: (.00%) Events: 6 
Survival Time Standard Error 95% Confidence Interval 
Mean: 409 129 (155, 662) 
Median: 306 110 ( 91,521) 


Survival Analysis for DAYS 


Total Number Number Percent 

Events Censored Censored 

GRADE 0 40 0 40 100.00 
GRADE т 9 4 5 55.56 
GRADE 2 6 6 0 .00 
Overall 55 10 45 81.82 


Breslow's Test 73.630, p « 0.001 


13. (a) Age: В - In(1.02) = .020; Hormone therapy: 8 = In(.89) = —.117; Pre-PSA: 
В = In(2.41) = .880; Tumor classification: В = In(1.42) = .351. 
(b) Age and hormone therapy were not significant in terms of long-term control of 
prostate cancer. Having a pre-treatment PSA of > 10 ng/mL and a high tumor 
classification were both significant risk factors (Pre-PSA increased the hazard by 2.41 
times and high tumor classification increased the hazard y 1.42 times). 
(c) 100(e9? — 1) = 2%; therefore, an increase in 1 unit of age increases long-term 
cancer risk by 2%. 


Chapter 15-ONLINE ONLY 


15.2.1 (a) 5.8 (b) White: 10.0, Black: 3.7, (c) 9.43 (d) 5.5 
(e) 9.43 (f) MN 22 2, MCD 34.5 
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15.2.3 

Age Population” Deaths’ U.S. Age- Standard Number of 

(Years) Population’ Specific Population Expected 
Death Based on Deaths in 
Rates US. Standard 
(per Population Population 
100,000) 2000 

0-4 539,509 1,178 19,175,798 218.3 68139 149 

5-14 1,113,920 224 841,077,577 20.1 145964 29 

15-24 1,117,439 954 39,183,891 85.4 139235 119 

25-34 1,213,415 1,384 39,891,724 114.1 141751 162 

35-44 1,287,120 2,823 45,148,527 219.3 160430 352 

45-54 1,085,150 5,271 37,677,952 485.7 133884 650 

55-64 723,712 8,035 24,274,684 1110.2 86257 958 

65 апа 

Over 969,048 51,863 34,991,753 5352.0 124339 6655 

Total 8,049,313 71,732  281,421,906 891.2 1000000 9073 


Age-adjusted death rate — 9.1 


15.3.1 


15.3.3 


15.4.1 


(a) (10-14): 1.3, (15-19): 59.9, (20-24): 126.7, (25-29): 112.6, (30-34): 83.6, 
(35-39): 36.5, (40—over): 2.6; (b) 2142.1 (c) (10-14): 6.3, (15-19): 
305.9, (20-24): 939.2, (25-29): 1502.3, (30-34): 1920.2, (35-39): 2102.9, (40- 
over): 2142.1 (d) 46.7 

(а) (10-14): 1.2, (15-19): 58.5, (20-24): 120.2, (24-29): 113.7, (30-34): 84.2, 
(35-39): 33.8, (40-44): 6.0, (45 and over): .5; (b) 2089.6 (c) (10-14): 
6.1, (15-19): 298.5, (20-24): 899.6, (25-29): 1468.1, (30-34): 1889.3, (35-39): 
2058.2, (40-44): 2088.1, (45 and over): 2089.6 (d) 45.6 

(а) immaturity ratio: 1997 —7.3, 2001—8.1 (b) prevalence ratio: Nevada— 
22.2, United States—20.5 (c) incidence rate—14.5 per 100,000 


Review Exercises 


9. 8.9 


11. Infant mortality: Total—5.7; white—5.3; nonwhite—6.5; Cause of death: heart 
disease total—36.8; white 37.7; nonwhite 32.3 Cancer total—23.7; white—-23.8; 
nonwhite—23.1 AIDS total—1.5; white .8; nonwhite 4.9 Immaturity ratio: total — 


7.0; 


white—6.7; nonwhite—7.5 Incident rate C-section: total—22.6; white 25.0; 


nonwhite—18.3 
13. 15.9,51.6 


INDEX 


Numbers preceded by A refer to Appendix pages. 


A 

Accuracy, 14 

Addition rule, 72-73 

Analysis of variance, 306—308 
assumptions, 307 
completely randomized design, 308—334 
one-way, 309—334 
procedure, 307—308 
randomized complete block design, 334—346 
repeated measures design, 346-356 
two-way, 336-346 

Arithmetic mean, 38 

Average hazard rate, 760 


B 
Backward elimination, 564 
Bayes's theorem, 68, 80-83 
Bernoulli process, 99-101 
P1, confidence interval, 438 
hypothesis test, 432-434 
Binomial distribution, 99-108 
parameters, 105-107 
table, A-3-A-31 
Use of table, 104—105 
Biostatistics, 3 
Birth rate, crude, 15-10 
Bivariate normal distribution, 445 
Bonferroni's method, 324, 327 
Box-and-whisker plot, 50—52 


C 

Case-fatality ratio, 15-14 
Cause-of-death ratio, 15-8 
Censored data, 752 

Central limit theorem, 139-140 
Central tendency, measures, 38—43 


Chi-square distribution, 195-197, 600—657 
mathematical properties, 601—604 
table, A-41 
use in goodness-of-fit tests, 604—619 
small expected frequencies, 604 
use in tests of homogeneity, 630-634 
small expected frequencies, 633 
use in tests of independence, 619-630 
small expected frequencies, 625 
2 x 2 table, 625-627 
Class interval, 22 
Coefficient of determination, 427—428 
Coefficient of multiple determination, 
501-503 
Coefficient of variation, 45-46 
Combination, 101 
Completely randomized design, 308-334 
ANOVA table, 317 
assumptions, 311 
Compound symmetry, 348 
Computers: 
and analysis of variance, 308, 321-323, 326-327, 
341-343, 350-351, 355 
and biostatistical analysis, 15-16 
and chi-square, 615, 623 
and descriptive statistics, 21, 22-30, 47 
and hypothesis testing, 232-233, 243-244, 
258—259 
and interval estimation, 169—170 
and logistic regression, 573 
and multiple correlation analysis, 512-519 
and multiple regression analysis, 494—496 
and random numbers, 16 
and simple linear regression and correlation 
analysis, 450—451 
and stepwise regression, 560—563 


l-1 


1-2 INDEX 


Confidence coefficient, 169 
Confidence interval: 
for В1, 438 
multiple regression, 506 


for difference between two population means, 


177—185 
nonnormal populations, 179-180 


for difference between two population 


proportions, 187-188 
for mean of Y, given X, 441—442 
for Шу...» 508—509 
for population mean, 165-178 
nonnormal populations, 168-171 
for population proportion, 185-186 
practical interpretation, 167 
for predicted Y, 441—442, 508—509 
probabilistic interpretation, 167 
for ratio of two variances, 198—201 
for p, 454 
for variance, 194—198 
Confusion matrix, 219 
Contingency table, 619 
Correction for continuity, 152 
Correlation coefficient: 
multiple, 510—513 
simple, 446—450 
Correlation model: 
multiple, 510—519 
simple, 445—446 
Cox regression model, 768-772 
hazard function, 768—769 
Critical region, 224 
Critical value, 224 
Cumulative frequencies, 25 
Cumulative relative frequencies, 25 


D 

Data, 2 
grouped, 22-37 
raw, 20 
sources, 3 

Death rate: 
crude, 15-3 
fetal, 15-7 
specific, 15-3 
standardized, 15-3 


Death rates and ratios, 15-3 through 15-10 
Death ratio, fetal, 15-7 

Decision rule, 218 

Degrees of freedom, 45 

Density function, 115 

Descriptive statistics, 2, 19-64 
Dispersion, measures, 43-49 
Distribution-free procedures, 671 

Dummy variable, 544-559 


E 
Epidemiology, 779 
Estimation, 161—210 
in simple linear regression analysis, 434, 
441 
Estimator, 165 
robust, 170 
Events: 
complementary, 74 
independent, 73—74 
mutually exclusive, 68 
EXCEL: 
and binomial distribution, 106 
Exclusive or, 73 
Experiments, 10 
designing, 14-15 
Exploratory data analysis, 52 
Extrapolation, 442, 459—460 


F 
Factorial, 101 
Factorial experiment, 358—369 
ANOVA table, 364 
assumptions, 362 
False negative, 79 
False positive, 79 
Family-wise error rates, 506 
F distribution, 199 
table of, A-42—A-51 
Fecundity, 15-10 
Fertility, 15-10 
measures, 15-10 through 15-12 
Fertility rate: 
age-specific, 15-11 
cumulative, 15-12 
general, 15-10 


standardized, 15-12 

total, 15-12 
Finite population correction, 141 
Fisher exact test, 636-640 

table for, А-55-А-85 
Fisher's z, 453-454 

table, A-54 
Fixed effects model, 311 
F-max test, 198 
Forward selection, 563 
Frequency distribution, 22-37 
Frequency polygon, 27 
Friedman test, 712—716 

table for, А-102-А-103 
F test, 316-317 


G 
Goodness-of-fit tests, 604—616 
Grouped data, 22-37 


H 
Histogram, 25-28 
Hypothesis, 215 
alternative, 216 
formulating, 14 
null, 216 
research, 215 
statistical, 216 
Hypothesis tests, 215—303 
by means of confidence interval, 225-226 
difference between means, 236—249 
nonnormal populations, 242—243 
population variances known, 236—238 
population variances unknown, 238—243 
for В;, multiple regression, 504—506 
for Ву, simple linear regression, 427—432 
one-sided, 226-228 
purpose, 215, 220 
single population mean, 222-236 
non-normal population, 230-232 
population variance known, 222-228 
population variance unknown, 228-230 
single population proportion, 257—259 
single population variance, 264—266 
steps in, 216 
two population proportions, 261—264 


INDEX 


two population variances, 267-272 
two-sided, 226 


I 

Immaturity ratio, 15-14 
Incidence rate, 15-13 
Inclusive or, 73 

Inferential statistics, 2, 162 
Interaction, 359—360, 550 
Interpolation, 442 
Interquartile range, 48 
Interval estimate, 165 
Interval scale, 6 


J 
Joint distribution, 445 


K 

Kaplan-Meier procedure, 756—761 

Kolmogorov-Smirnov test, 698—703 
advantages and disadvantages, 703 
and StatXact computer analysis, 702 
table for, A-99 

Kruskal-Wallis test, 704—709 
table for, A-100—A-101 

Kurtosis, 48—49 


L 

Least squares, method, 420 
Least-squares line, 420—422 
Levene's test, 201, 270 
Location parameters, 47 
Log rank test, 763—765 
Logistic regression, 569—581 
Loss to followup, 751 


M 

Mann-Whitney test, 690-696 
table for, А-95-А-98 
Mantel-Haenszel statistic, 650-653 
Margin of error, 168 

Mean, 38-40 

properties, 40 
Measurement, 6 
Measurement scales, 5-6 
Median, 40 

properties, 41 
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Median test, 686—689 

MINITAB: 
and binomial distribution, 107 
and box-and-whisker plots, 51—52 
and chi-square, 615—616, 623, 632 


and confidence intervals for a mean, 169-170 


and descriptive measures, 47 
and dummy variables, 546—547, 550, 555 
and factorial experiment, 367—368 
and frequency distributions, 27 
and Friedman test, 716 
and histograms, 26—27 
and hypothesis testing, 253, 258-259 
and Kruskal-Wallis test, 709 
and Mann-Whitney test, 694-696 
and median test, 689 
and multiple correlation, 512, 515, 517 
and multiple regression, 495, 508 
and normal distribution, 126-127 
and one-way ANOVA, 321-322 
and ordered array, 20-21 
and Poisson distribution, 111—112 
and repeated measures ANOVA, 349—350 
and sign test, 680 
and simple linear regression, 421, 444 
and Spearman rank correlation, 724 
and stem-and-leaf displays, 29-30 
and stepwise regression, 560—563 
and two-way ANOVA, 341—342 
and Wilcoxon test, 685 
Mode, 41 
Morbidity, 15-13 
measures, 15-13 through 15-14 
Mortality rate: 
infant, 15-7 
maternal, 15-6 
neonatal, 15-7 
perinatal, 15-7 
Multicollinearity, 542 
Multiple comparison, 322-326 
Multiple correlation coefficient, 
510—513 
Multiple correlation model, 510—513 
Multiplication rule, 71—72 
Multivariate distribution, 510 
Multivariate normal distribution, 510 


N 

Nominal scale, 6 

Nonparametric statistics, 671—747 

Nonrejection region, 218 

Normal distribution, 118-127 
applications, 122-127 
characteristics, 118-119 
standard, 118-122 
table, A-38-A-39 


о 

Observation, 14 

Observational study, 642-643 
Odds ratio, 645—648 

Ogive, 96 

Operating characteristic curve, 277 
Ordered array, 20-21 

Ordinal scale, 6 

Outliers, 52 


P 
Paired comparisons, 249—254 
Parameter, 38 
Partial correlation, 513—519 
Partial regression coefficients, 492 
Percentile, 47 
Point estimate, 163 
Poisson distribution, 108-113 
table of, A-32-A-37 
Poisson process, 109 
Population, 5 
finite, 5 
infinite, 5 
sampled, 164 
target, 164 
Power, 272-279 
Precision, 14, 168 
Predictive value negative, 80 
Predictive value positive, 80 
Prospective study, 642 
Prediction interval 
multiple regression, 508—509 
simple linear regression, 441—442 
Prevalence rate, 15-14 
Probability, 65-85 
posterior, 68 


prior, 68 

classical, 66-67 

conditional, 70 

joint, 71 

marginal, 70, 75 

objective, 66—67 

personalistic, 67 

properties, 68—69 

relative frequency, 67 

subjective, 67-68 

Probability distributions, 92-132 

of continuous variables, 113-128 

of discrete variables, 93-113 
cumulative, 96-98 
properties, 95 


Product-limit method, see Kaplan-Meier procedure 


Proportional hazards model, see Cox regression 
model 

Proportional mortality ratio, 15-8 

p values, 225 


Q 
Qualitative variables, 4, 543-556 
Quartile, 47—48 


R 
R 
and box-and-whisker-plots, 51 
and confidence interval between two means, 
183 
Random digits, table, A-2 
use, 9-10 
Randomized complete block design, 334-346 
ANOVA table, 338 
assumptions, 337 
Range, 43-44 
Rank transformation, 672 
Rate, 15-2 
Ratio, 15-2 
Ratio scale, 6 
Regression: 
logistic, 569-581 
multiple, 489-510 
assumptions, 491 
equation, 491-492 
model, 490-492 


INDEX 


nonparametric, 727-730 
resistant line, 442-444 
simple linear, 413-446 
assumptions, 415-416 
equation, 417-423 
model, 414-416 
stepwise, 560-564 


Rejection region, 218 

Relative frequencies, 24-25 
Relative risk, 643-645 

Reliability, 14 

Reliability coefficient, 167 
Repeated measures design, 346-356 


assumptions, 347-348 
definition, 347 


Research study, 10 
Residual, 429 

Resistant line, 442-444 
Retrospective study, 643 
Risk factor, 642 


S 


Sample, 5 


convenience, 165 

nonrandom, 164-165 

random, 164-165 

simple random, 7-10 

size for controlling Type II errors, 
277-279 

size for estimating means, 189-191 

size for estimating proportions, 191-193 

stratified proportional to size, 13 

stratified random, 12 

stratified systematic, 12 

systematic, 11 


Sampling distribution, 135-160 


characteristics, 136 

construction of, 135 

definition, 135 

of difference between sample means, 145-150 
nonnormal populations, 148 

of difference between sample proportions, 

154-156 

of sample mean, 136-145 
nonnormal populations, 139-141 

of sample proportion, 150-153 
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SAS: 
and chi-square analysis, 623-625 
and descriptive measures, 47 
and factorial experiment, 367, 368 
and hypothesis testing, 233, 244-245 
and logistic regression, 572-576 
and multiple regression, 493, 496 
and one-way ANOVA, 322 
and repeated measures ANOVA, 350-351 


and simple linear regression and correlation, 


442-443, 450-451 
and Tukey's HSD test, 326 
and two-way ANOVA, 341—342 
Scatter diagram, 419—420 
Scientific methods, 13-15 
Secondary attack rate, 15-14 
Sensitivity, 80 
Significance level, 218-219 
Sign test, 673—680 
Simple random sampling, 7-10 
without replacement, 7-8 
with replacement, 7-8 
Skewness, 41—42 
Slope, 415 


Spearman rank correlation coefficient, 718—724 


table for, A-104 
Specificity, 80 
Sphericity, 348 
SPSS: 
and Fisher exact test, 640 
and frequency distribution, 25-26 
and kurtosis, 49 
and logistic regression, 577 
and Mann-Whitney test, 695-696 
and Mantel-Haenzcel test, 652—653 
and multiple regression, 493 
and odds ratio, 648 
and partial correlation, 516, 518-519 
and repeated measures ANOVA, 350-351 
and skewness, 43 
and survival analysis, 665-666 
and Tukey's HSD test, 327 
Standard deviation, 45 
Standard error of mean, 139 
Standard normal distribution, 118-122 
table of, А-38-А-39 


Statistic, 38 
Statistical inference, 7, 162 
Statistics, 2 
Stem-and-leaf-display, 28-30 
Stepwise regression, 560-569 
Studentized range, 324 
table of, A-52-A-54 
Student's distribution, 172-177 
table of, A-40 
Sturges” rule, 22 
Survival analysis, 750—776 
censored survival times, 752 
types, 752—753 
Cox regression, hazard function, 768-772 
cumulative distribution function, 754 
Kaplan—Meier procedure, 756—761 
nonparametric technique, 756 
probability of surviving, 756—757 
probability distribution function, 755 
statistical distribution functions, 753 
survival curves, comparing, 763—766 
time-to-event data, 751—756 


T 
t distribution, 171-177 
and difference between means, 179—183 
population variances equal, 179-180 
population variances not equal, 180-183 
properties, 172 
table of, A-40 
Time-to-event data, see Survival analysis 
Test statistic, 217—218 
Trimmed mean, 170 
Tukey's HSD test, 323-324 
Tukey”s line, 443-444 
Type I error, 219 
Type II error, 219, 272-279 


U 

Unbiasedness, 163 

Uniform distribution, 614-616 
Unit of association, 459 


У 
Variable, 3 
continuous random, 4 


dependent, 415 
discrete random, 4 
dummy, 544—556 
explanatory, 490 
extraneous, 307 
independent, 415 
predictor, 417, 490 
qualitative, 4, 543-556 
quantitative, 4 
random, 4 
response, 307, 417 
treatment, 307 


Variable selection 


procedures, 560-564 


INDEX 


Variance, 44-45 

interval estimation, 194-197 
Variance ratio, 316 
Variance ratio test, 198, 268-272 
Vital statistics, 778—796 


W 
Weibull distribution, 755—756 
Wilcoxon test, 681—686 

table for, A-86-A-95 


Y 
Yates' correction, 627 
y-intercept, 415 


